🚀 Excited to Share My First Tech Blog! 🚀 After months of hands-on experience and analysis, I've published my first Medium article, titled "Build your own CI/CD Pipeline for Snowflake, Airflow, DBT, Python & Other Configuration Files (Data Pipeline)". 🎉 This blog is a comprehensive guide for data engineers, covering the design and implementation of an end-to-end CI/CD pipeline. Whether you're dealing with Snowflake, Airflow, DBT, or other configuration files, this article is designed to help you streamline deployments efficiently and effectively. 🔗 Check it out here: https://lnkd.in/gh7JGhtp I'm eager to hear your feedback and would love for this to spark insightful discussions. If you find it useful, please like, comment, or share it with your network. Your support means a lot as I take this exciting step in sharing knowledge with the community! #DataEngineering #CICD #MediumBlog #Snowflake #Airflow #DBT #Python
Sanjay R B’s Post
More Relevant Posts
-
Empowering data engineers! Do check out this comprehensive guide to building CI/CD pipelines for Snowflake, Airflow, DBT & Python by my amazing team member Sanjay R B. #DataEngineering #CICD"
TCS Innovator | System Engineer at TCS | GCP ACE & PCEP - Certified | Hybrid Application Developer | Flutter Enthusiastic
🚀 Excited to Share My First Tech Blog! 🚀 After months of hands-on experience and analysis, I've published my first Medium article, titled "Build your own CI/CD Pipeline for Snowflake, Airflow, DBT, Python & Other Configuration Files (Data Pipeline)". 🎉 This blog is a comprehensive guide for data engineers, covering the design and implementation of an end-to-end CI/CD pipeline. Whether you're dealing with Snowflake, Airflow, DBT, or other configuration files, this article is designed to help you streamline deployments efficiently and effectively. 🔗 Check it out here: https://lnkd.in/gh7JGhtp I'm eager to hear your feedback and would love for this to spark insightful discussions. If you find it useful, please like, comment, or share it with your network. Your support means a lot as I take this exciting step in sharing knowledge with the community! #DataEngineering #CICD #MediumBlog #Snowflake #Airflow #DBT #Python
Build your own CI/CD Pipeline for Snowflake, Airflow, DBT, Python & Other Configuration Files…
link.medium.com
To view or add a comment, sign in
-
Just saw that Snowflake has released the Public Preview of Notebooks this morning! Amazing feature. Check out some of its key capabilities: 1) Write code in the way that works best for you, whether it's SQL queries or Python scripts. 2) You can convert notebook cells into tasks and schedule them for regular execution. 3) Notebooks can be managed through Git integration. #Snowflake
To view or add a comment, sign in
-
🚀 Can we use Databricks CLI without installing it? You will be amazed like me! I recently stumbled upon an incredible method to use the Databricks CLI without the hassle of installing any executable files on your machine. 😲 Curious to know how? Check out my latest blog where I dive into the details of this game-changing approach. https://lnkd.in/dJw8C_x2 Whether you're a Databricks pro or just getting started, this could simplify your workflow and save you some serious setup time. Check out my other blogs for insightful content! 📚 https://lnkd.in/dkkcHVXq Follow Rahul Madhani for more insights and updates. 🚀 If you found this post helpful, please help others by reposting it ♻️ #Databricks #CLI #Python #CloudComputing #TechTips #DataScience #MachineLearning #DataEngineering #DataEngineer
Can we use Databricks CLI without installing it? You will be amazed like me
blog.det.life
To view or add a comment, sign in
-
Want to write Python on your #snowflake data? Check out Snowflake Notebooks 📓! One surface for all of your SQL, Python, Snowpark, Cortex, and Streamlit coding experience serving #datascience and #ai #ml workloads 🤗. Notebooks 101 YouTube demo: https://lnkd.in/g3GwEbXU 🔆 Feature highlights: • Build off of SQL and Python cells with easy cell referencing • Write up a narrative on your analysis with Markdown cells • Import your favorite packages from Anaconda (`pip install` coming soon!) • Flexible compute options to balance performance and costs • No environment setup. Create and go! (We’re in Private Preview and would love to hear your thoughts! Please email [email protected] directly for feedback.)
To view or add a comment, sign in
-
Ready to transform your data? Join us for a free webinar on Python data wrangling and cleaning. Spaces are limited – secure yours now! https://zurl.co/WjhW #PythonSkills #DataScience #WebinarAlert
To view or add a comment, sign in
-
Further integration in Snowflake Data Cloud for data science. This will start to challenge the role of key partner products (like Hex) but also provide the ability to democratise data science further into a business with a full ecosystem.
Want to write Python on your #snowflake data? Check out Snowflake Notebooks 📓! One surface for all of your SQL, Python, Snowpark, Cortex, and Streamlit coding experience serving #datascience and #ai #ml workloads 🤗. Notebooks 101 YouTube demo: https://lnkd.in/g3GwEbXU 🔆 Feature highlights: • Build off of SQL and Python cells with easy cell referencing • Write up a narrative on your analysis with Markdown cells • Import your favorite packages from Anaconda (`pip install` coming soon!) • Flexible compute options to balance performance and costs • No environment setup. Create and go! (We’re in Private Preview and would love to hear your thoughts! Please email [email protected] directly for feedback.)
To view or add a comment, sign in
-
Discover the future of data workflows with Snowflake Notebooks! Seamlessly integrate Python, SQL, and Markdown for enhanced productivity and collaboration. Unlock powerful features like Snowpark ML, Streamlit, native Git support, and advanced ML workflows. Transform your data processes today! #cci #cloudconsultings #snowflake #DataScience #MachineLearning #Analytics #SnowflakeNotebooks
To view or add a comment, sign in
-
Almost like a #fullstack developer bootcamp, this course covers a wide array of technologies that will help you build applications that use Snowflake as a back end. Including Streamlit (Python), #SnowSQL, REST APIs, and much more. What tasks are performed to achieve this badge? 1. Create UI entry forms in #Streamlit to collect data 2. Write #Python to insert collected data into #Snowflake tables 3. Set Up GitHub - Already had one. 4. Make #RESTAPI calls to collect data. 5. Write Python to retrieve data from Snowflake tables Any Questions? Comment Below. Follow for more Muhammad Raza Khalid Saleemi. #dataengineering #dataanalytics #datascience #restapis #tech #backend #data
To view or add a comment, sign in
-
I’m happy to share that I’ve obtained a new certification: Hands-On Essentials: Data Application Builders Workshop from Snowflake! Take aways: Almost like a full-stack developer bootcamp, this course covers a wide array of technologies that will help you build applications that use Snowflake as a back end. Including: Streamlit (Python), SnowSQL, REST APIs, and much more. #Snowflake #Streamlit #API
To view or add a comment, sign in
-
✨Data Quality 💎 with dbt in just 3 easy steps: ✅ Configure the Data Source (Databricks): Set up your Databricks connection to start working with your data effortlessly. ✅ Run the Models: Define and execute the models (tables) that will be loaded into Databricks. ✅ Run Tests: Execute validations on the same tables to ensure your data's quality and integrity. In the first 2 minutes the overview is shown. The rest of the time is for test execution using "Run Test" 👨🏽🔧✨💎 #DataEngineering #dbt #Databricks #DataTransformation #Python #Databricks
To view or add a comment, sign in
Technology CoE | Robotics | IoT | EV Charger | Smart Heating | Product Engineering | Testing Solutions
1wThis is great 😃 Sanjay R B