#DataIngestion

2025-02-24

DB2 External Tables: Accessing Flat Files in DB2 for LUW
Streamline data ingestion into DB2 LUW with DB2 External Tables! Access flat files directly, simplifying data integration & eliminating complex custom solutions. Learn more now!
tech-champion.com/database/db2
Learn about DB2 External Tables a feature enabling access to flat files (like CSV) directly f...

Microsoft DevBlogsmsftdevblogs@dotnet.social
2025-02-08
2025-01-20

Task update: I’m working with Docker-Compose and PostgreSQL in the '01-docker-terraform' module of the by @DataTalksClub. Just ingested the 'Green Taxi Trips' dataset from October 2019 into PostgreSQL—loving the hands-on task experience! 🚖

2024-12-17

Sentinel Tip - Use Custom Logs: Create custom logs for unique data sources not covered by built-in connectors. This allows you to ingest and analyze data from virtually any source. #CustomLogs #DataIngestion #Flexibility

VictoriaMetricsvictoriametrics
2024-11-19

There's a conference going on these days osacon.io hosted by our friends from altinity.com, and we're happy to be a Partner sponsor of the event 😎

It covers all things open-source analytics incl. data ingestion, orchestration, databases, infrastructure, governance, visualization, AI, and more.

Join us (it's free), we look forward to seeing you there!

2024-09-24

Sentinel Tip - Monitor Data Ingestion: Regularly monitor data ingestion to ensure all critical data is being collected. Monitoring helps in identifying and resolving ingestion issues. #DataIngestion #Monitoring #QualityControl

LINUXexpert.orglinuxexpert
2024-07-29

The Hadoop ecosystem comprises various tools and frameworks designed to handle large-scale data processing and analytics. Let's discuss the core components, namely Hadoop, HBase, and Hive, along with other significant tools such as Pig, Sqoop, Flume, Oozie, and Zookeeper.

linuxexpert.org/so-you-wanna-d

Alex Merced - 🥑 @ Dremioalexmerced@data-folks.masto.host
2024-05-03

EXPERIENCE THE DREMIO LAKEHOUSE

Watch a video demonstration from ingestion to dashboard using Dremio’s “Git For Data” features, dbt integration, data reflections and more here:

bit.ly/am-dataops-demo

Walk through the same experience you see in the video first hand on your laptop and experience the power of Dremio in a local environment using this blog:

bit.ly/dremio-experience

#DataLakehouse #DataEngineering #BigData #DataAnalytics #DataScience #DataIngestion #BIDashboards

2023-03-20

I discovered a crazy bug today trying to import data from an Excel file into a Laravel app.

Modern Excel files are actually zip files containing several XML files in a specific directory structure, but it seems that within the zip file the "directory structure" is not real, so each XML file just has some directory structure like stuff prepended to its file name.

In the particular Excel file I'm importing, the XML file that knows about the different worksheets in the Excel workbook was saved with the "/" characters in its directory structure as backslashes. This seems very unexpected, none of the Excel packages I tried for PHP could read it.

In the end I used PHP's built-in ZipArchive class to rename the XML file in the Excel archive, then it could be imported properly.

That wasn't how I expected to spend my afternoon!

#UntrustedData #PHP #DataIngestion #WeirdBugs #DeveloperLife

EU Maritime & FishEU_MARE@respublicae.eu
2023-02-09

RT @MarianneBMDC: Want to join the EMODnet?

Wake up your data ! Set them free for blue society and you will get a strong net in return @EMODnet #DataIngestion

📽️youtube.com/watch?v=p3vwngxyXu
📽️ youtube.com/watch?v=EEjoSgFBOO

@EU_MARE @SeaDataNet
#EMODnet #CentralPortal #MarineData #FAIRdata #BlueSociety

🐦🔗: n.respublicae.eu/EU_MARE/statu

The European Marine Observation and Data Network (EMODnet) launches its fully unified marine data service with major functionality upgrades. 

EMODnet has reached a new stage as it launches its fully centralised marine data service, integrating all of its thematic services into one single portal. This thematic unification is a major upgrade, which simplifies access and enhances the EMODnet user experience. 
Central to the upgrade and major improvement is the release of the common map viewer, which offers the user easy and seamless access to discover, visualise and download marine data across seven thematics including marine environment and human activities and hundreds of data and data products from one place, powered by a searchable unified catalogue. For more information visit our website: https://emodnet.ec.europa.eu/
OpenBiblioJobsobj@openbiblio.social
2022-09-13

Informationsspezialist*in (m/w/d), TV-L E 13, Vollzeit, auf 2 Jahre befristet Leibniz-Institut für Psychologie (ZPID) | Bewerbungsfrist: 01.10.2022 leibniz-psychology.onlyfy.jobs | jobs.openbiblio.eu/stellenange #openbibliojobs #dataingestion #Repositorium #OpenAccess #DSpace

Client Info

Server: https://mastodon.social
Version: 2025.04
Repository: https://github.com/cyevgeniy/lmst