PinnedEssential Considerations for Data Engineers When Selecting a NoSQL DatabaseIn the realm of modern data engineering, the choices abound, and the stakes are high. Data engineers are the architects of the digital age…Sep 4, 2023A response icon18Sep 4, 2023A response icon18
Pinned2022 : Modern Data StackYou might have seen multiple posts around this subject as time keeps evolving and bringing changes into tech stack, however this includes…May 3, 2022A response icon15May 3, 2022A response icon15
PinnedDuckDB: Primer on the subject and fascinating highlightsThroughout our data engineering journey, we’ve come across a myriad of database management systems (DBMS). But what sets DuckDB apart from…Jul 2, 2023A response icon6Jul 2, 2023A response icon6
Google Spanner: The Database That Scales Globally with Strong ConsistencyIn the modern data engineering landscape, companies require applications that can scale globally without compromising on performance and…Nov 13, 2024Nov 13, 2024
POLARS: A Swift and Powerful DataFrame Library for Analytical TasksEssential to data engineering and data science are the tasks of data manipulation and analysis. Pandas has long been the staple library for…Jun 19, 2024Jun 19, 2024
Harnessing the Potential of Databricks Liquid Clustering: A Dynamic Data Layout Scaling with Growth…Databricks made waves at the previous Data + AI Summit by introducing Liquid Clustering alongside Delta Universal Format (UniForm) and…Jan 3, 2024A response icon2Jan 3, 2024A response icon2
Airbyte Spotlight: The Open-Source Solution for Data Integration — Features, Benefits, and…Data integration is foundational to the success of modern businesses, fostering better decision-making, operational efficiency, and…Dec 26, 2023A response icon1Dec 26, 2023A response icon1
Fast-Track PySpark UDF execution with Apache ArrowDevelopers often create custom UDFs (user-defined-functions) in their Spark code to handle specific transformations. This allows users to…Nov 19, 2023Nov 19, 2023
RAY: Distributed computing framework for ML & AIThe evolving domain of artificial intelligence and machine learning is witnessing an unprecedented demand for tools that are efficient…Nov 6, 2023Nov 6, 2023
Key Database Compaction Strategies Used In Distributed SystemIn the realm of distributed database systems, the adoption of compaction strategies plays a pivotal role in the effective management of…Sep 4, 2023Sep 4, 2023
