Google is making it faster for cloud customers to process data for analysis with a forthcoming feature called Cloud Dataflow Shuffle. It’s designed to make consuming streaming and batch processed data up to five times faster than before by applying technology the tech giant developed in-house.
The feature is built for Google’s Cloud Dataflow service, which helps customers process data before feeding it into databases, machine learning applications, and other systems. Customers set up processing tasks in Cloud Dataflow using pipelines written with the Apache Beam SDK, then Google handles the provisioning and scaling of compute resources necessary to handle those tasks.
Cloud Dataflow Shuffle accelerates those pipelines by using a Google-made system to manage shuffle operations, which sort data from multiple compute nodes. When this launches, customers will get the…
The post Google accelerates customer data processing with new cloud feature appeared first on FeedBox.