How Roblox Reduces Spark Join Query Costs With Machine Learning

Abstract Every day on Roblox, 70 million users engage with millions of experiences, totaling 16 billion hours quarterly. This interaction generates a petabyte-scale data lake, which is enriched for analytics and machine learning (ML) purposes. It’s resource-intensive to join fact and dimension tables in our data lake, so to optimize this and reduce data shuffling, […]

PDF) The Optimization of Cost-Model for Join Operator on Spark SQL Platform

What I Learned From Attending Tecton's apply() Conference, by James Le

What I Learned From Attending Tecton's apply() Conference — James Le

How Concur uses Big Data to get you to Tableau Conference On Time

Roblox on LinkedIn: How Roblox Reduces Spark Join Query Costs With Machine Learning Optimized…

What I Learned From Attending TWIMLCon 2021, by James Le

Making Sense of the Metadata: Clustering 4,000 Stack Overflow tags with BigQuery k-means - Stack Overflow

How Roblox Reduces Spark Join Query Costs With Machine Learning Optimized Bloom Filters : r/roblox

What I Learned From Attending TWIMLCon 2021, by James Le

How does Apache Spark 3.0 increase the performance of your SQL workloads - Cloudera Blog

Practical Automated Machine Learning Using H2O.ai - Ajgaonkar, PDF, Machine Learning

The art of joining in Spark. Practical tips to speedup joins in…, by Andrea Ialenti

Cost Based Optimizer in Apache Spark 2.2, by Jules S. Damji, Databricks Engineering

roblox display name now you can type underscore