MENU

Fun & Interesting

Easier data and asset sharing across projects and teams with {pins} and Databricks

Posit PBC 710 3 days ago
Video Not Working? Fix It Now

Led by Edgar Ruiz, Software Engineer at Posit PBC April 30th at 11 am ET / 8 am PT Sharing data assets can be challenging for many teams. Some may rely on emailed files to keep analyses up to date, making it difficult to keep current or know what version of the data is used. {pins} improves sharing data and other assets across projects and teams. It enables us to publish, or ‘pin’, to a variety of places, such as Amazon S3, Posit Connect and Dropbox. Given recent customer feedback, the ability to publish, or ‘pin’ to Databricks Volumes has been added to R. The same capability is also currently in the works for the Python version of {pins}. This session on April 30th will showcase the acceleration of predictions by distributing a 'pinned' model using pins and Spark in Databricks. We’ll walk through integrating {pins} with Databricks in your team’s projects and cover novel uses of pins inside the Databricks ecosystem. GitHub repo: https://github.com/edgararuiz/talks/tree/main/end-to-end Here are a few additional resources that you might find interesting: 1. Pins for R: https://pins.rstudio.com/ 2. Pins for Python: https://rstudio.github.io/pins-python/ 3. More information on how Posit and Databricks work together: https://posit.co/use-cases/databricks/ 4. Customer Spotlight: Standardizing a safety model with tidymodels, Posit Team & Databricks at Suffolk Construction: https://youtu.be/yavHEWpgrCQ 5. Q&A Recording: https://youtube.com/live/HDTDmEaK5zQ?feature=share

Comment