Data Engineering

data_engineering@programming.dev

PostsComments

houseofleft@slrpnk.netEnglish · 1 month ago

Fun with Hy and Pandas

benrutter.github.io

0

2

Fun with Hy and Pandas

benrutter.github.io

houseofleft@slrpnk.netEnglish · 1 month ago

0

Sem@lemmy.mlEnglish · 3 months ago

Efficiently Manage Memory Usage in Pandas with Large Datasets

0

7

Efficiently Manage Memory Usage in Pandas with Large Datasets

Sem@lemmy.mlEnglish · 3 months ago

0

Andy@lemmy.world · 3 months ago

Shift Left

3

-4

Shift Left

Andy@lemmy.world · 3 months ago

3

ericjmorey@programming.devM · 3 months ago

Dremio is offering free pdf copies of "Apache Iceberg: The Definitive Guide: Data Lakehouse Functionality, Performance and Scalability on the Data Lake"

hello.dremio.com

1

11

Dremio is offering free pdf copies of "Apache Iceberg: The Definitive Guide: Data Lakehouse Functionality, Performance and Scalability on the Data Lake"

hello.dremio.com

ericjmorey@programming.devM · 3 months ago

1

ericjmorey@programming.devM · 4 months ago

Postgres vs. Pinecone | Lantern Blog | Narek Galstyan | July 18, 2024

0

10

Postgres vs. Pinecone | Lantern Blog | Narek Galstyan | July 18, 2024

ericjmorey@programming.devM · 4 months ago

0

ericjmorey@programming.devM · 4 months ago

Definite: Comparing Iceberg Query Engines (with Duckdb and Iceberg Full Notebook Example) | Steven Wang | 7/3/2024

www.definite.app

0

7

Definite: Comparing Iceberg Query Engines (with Duckdb and Iceberg Full Notebook Example) | Steven Wang | 7/3/2024

www.definite.app

ericjmorey@programming.devM · 4 months ago

0

Sem@lemmy.mlEnglish · 4 months ago

A guide how to adopt an existing Spark scala library for Spark Connect

semyonsinchenko.github.io

0

6

A guide how to adopt an existing Spark scala library for Spark Connect

semyonsinchenko.github.io

Sem@lemmy.mlEnglish · 4 months ago

0

Andy@lemmy.world · 5 months ago

Why Use Data Build Tools (dbt)

1

10

Why Use Data Build Tools (dbt)

Andy@lemmy.world · 5 months ago

1

gecloslatitude@lemmy.worldEnglish · 6 months ago

7 best open-source chart libraries for developers

0

1

7 best open-source chart libraries for developers

gecloslatitude@lemmy.worldEnglish · 6 months ago

0

Andy@lemmy.world · 6 months ago

Building a real-time data pipeline - Technical article and GitHub repo

0

19

Building a real-time data pipeline - Technical article and GitHub repo

Andy@lemmy.world · 6 months ago

0

Andy@lemmy.world · 6 months ago

Diagrams as Code

7

18

Diagrams as Code

Andy@lemmy.world · 6 months ago

7

gecloslatitude@lemmy.worldEnglish · 6 months ago

6 Best Embedded Databases for 2024

2

0

6 Best Embedded Databases for 2024

gecloslatitude@lemmy.worldEnglish · 6 months ago

2

ericjmorey@programming.devM · 8 months ago

Building Meta’s GenAI Infrastructure

engineering.fb.com

0

5

Building Meta’s GenAI Infrastructure

engineering.fb.com

ericjmorey@programming.devM · 8 months ago

0

ericjmorey@programming.devM · 8 months ago

Building data abstractions with streaming at Yelp

engineeringblog.yelp.com

0

7

Building data abstractions with streaming at Yelp

engineeringblog.yelp.com

ericjmorey@programming.devM · 8 months ago

0

Andy@lemmy.world · 8 months ago

Building a Data Pipeline from Scratch

0

6

Building a Data Pipeline from Scratch

Andy@lemmy.world · 8 months ago

0

Pyr_Pressure@lemmy.ca · 9 months ago

Data Newbie Looking for Advice

4

17

Data Newbie Looking for Advice

Pyr_Pressure@lemmy.ca · 9 months ago

4

Sem@lemmy.mlEnglish · 9 months ago

An implementation of Apache Spark physical execution from Apple

0

8

An implementation of Apache Spark physical execution from Apple

Sem@lemmy.mlEnglish · 9 months ago

0

Andy@lemmy.world · 9 months ago

Infrastructure-as-Code Demo of Terraform on Snowflake

2

4

Infrastructure-as-Code Demo of Terraform on Snowflake

Andy@lemmy.world · 9 months ago

2

ericjmorey@programming.devM · 9 months ago

Spark vs Presto: A Comprehensive Comparison

www.analyticsvidhya.com

6

6

Spark vs Presto: A Comprehensive Comparison

www.analyticsvidhya.com

ericjmorey@programming.devM · 9 months ago

6

Andy@lemmy.world · 9 months ago

Offline listening and speaking bot

2

13

Offline listening and speaking bot

Andy@lemmy.world · 9 months ago

2

Data Engineering@programming.dev

data_engineering@programming.dev

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !data_engineering@programming.dev

A community for discussion about data engineering

Icon base by Delapouite under CC BY 3.0 with modifications to add a gradient

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

2 users / day
2 users / week
2 users / month
91 users / 6 months
1 local subscriber
379 subscribers
38 Posts
32 Comments
Modlog

mods:
ericjmorey@programming.dev

programming.dev

A collection of programming communities

Welcome Programmers!

programming.dev is a collection of programming communities and other topics relevant to software engineers, hackers, roboticists, hardware and software enthusiasts, and more.

The site is primarily english with some communities in other languages. We are connected to many other sites using the activitypub protocol that you can view posts from in the “all” tab while the “local” tab shows posts on our site.

🔗 Site with links to all relevant programming.dev sites

🟩 Not a fan of the default UI? We have alternate frontends we host that you can view the same content from

ℹ️ We have a wiki site that communities can host documents on

⚖️ All users are expected to follow our Code of Conduct and the other various documents on our legal site

❤️ The site is run by a team of volunteers. If youre interested in donating to help fund things such as server costs you can do so here

💬 We have a microblog site aimed towards programmers available at https://bytes.programming.dev

🛠️ We have a forgejo instance for hosting git repositories relating to our site and the fediverse. If you have a project that relates and follows our Code of Conduct feel free to host it there and if you have ideas for things to improve our sites feel free to create issues in the relevant repositories. To go along with the instance we also have a site for sharing small code snippets that might be too small for their own repository.

🌲 We have a discord server and a matrix space for chatting with other members of the community. These are bridged to each other (so you can interact with people using matrix from discord and vice versa.

Fediseer