Best practices from experts to maximize BigQuery performance (featuring Twitter)
Ғылым және технология
You’ve made the decision to run your data analytics on BigQuery’s serverless platform. As you deploy complex workloads on your data, you want to maximize the performance of all data operations from data loading to data analytics.
Learn the performance best practices from speeding up your data ingest into BigQuery to learning the tips and tricks from the BigQuery engineering team to maximize query performance of your data warehouse.
Speakers: Jagan Athreya, Gary Steelman
Watch more:
Google Cloud Next ’20: OnAir → goo.gle/next2020
Subscribe to the GCP Channel → goo.gle/GCP
#GoogleCloudNext
DA201
product: BigQuery; fullname: Jagan Athreya;
event: Google Cloud Next 2020; re_ty: Publish; product: Cloud - Data Analytics - BigQuery; fullname: Jagan Athreya, Gary Steelman; event: Google Cloud Next 2020;
Пікірлер: 9
At 2:15, Jagan says: "Data is stored in Colossus, which is BigQuery's columnar storage which is encrypted, replicated and distributed making it highly durable against failures" He is mixing two concepts: Colossus (Google's DFS) and Capacitor (BigQuery's columnar storage). Jagan should've said: "Data is stored in Capacitor, which is BigQuery's columnar storage. In turn, Capacitor files are stored in Colossus which is Google's encrypted, replicated and distributed file system making it highly durable against failures"
Awesome, Jagan
Thank You
it’s nice to have the power point representation but what about with technical approach on how we can implement this in real time ?
At 11:41, you mention 'Ingest from GCS or HTTP POST...' Could you please explain what you mean by or give an example of the 'HTTP POST' method?
@jaganathreya8680
3 жыл бұрын
Loading data from a local data source: cloud.google.com/bigquery/docs/loading-data-local
Poor Presentation, slides where not used effectively
Please help me
He is just reading slides