Best Open Source Tools for Data Migration

https://www.simplyblock.io/blog/open-source-tools-for-data-migration/

So I said I was gonna be posting Data Engineering stuff here and this is my first attempt at that, hehehe.

https://buildingblocks.hashnode.dev/getting-started-with-apache-nifipart-1

#apachenifi #dataengineering

New release of the python Apache Nifi library NiPyApi: https://github.com/Chaffelson/nipyapi/releases/tag/v0.21.0
#nifi #apachenifi

Recentemente, tenho avaliado escrever e gravar alguns conteúdos sobre tratamento de dados, automação, integração com pacotes de escritório e boas práticas no geral. Trabalhei por 3,5 anos numa consultoria (um escritório de planejamento urbano e regional) e percebi que há muitas lacunas, mesmo quando o #QGIS está presente. Em matéria de tratamento de dados e automação, sou usuário do #KNIME, logo, decidi dar uma olhada em alternativas, como #Pentaho (PDI, que já conhecia de outros carnavais) e #ApacheHop, mas a que mais achei curiosa foi o #ApacheNiFi.

In my second blog post on Apache NiFi we run it up in a container to have a play: https://mattjhayes.com/2023/12/04/experimenting-with-nifi/ #NiFi #ApacheNiFi

Getting ready for Apache Nifi 2.0 by Pierre Villard

https://medium.com/cloudera-inc/getting-ready-for-apache-nifi-2-0-5a5e6a67f450

#apache #apachenifi #nifi

If you’re running an Apache NiFi instance exposed on the internet and you have not secured access to it, the underlying host may already be covertly cryptomining on someone else’s behalf.

https://www.helpnetsecurity.com/2023/05/31/apache-nifi-cryptomining/

@sans_isc @jullrich #Cybersecurity #ApacheNiFi

Processing Linked Data Event Streams with #apachenifi and #TimescaleDB

https://blog.timescale.com/blog/the-power-of-linked-data-event-streams-and-timescaledb-for-real-time-management-of-time-series-data/

Great to be in NYC, even better to get to present at the Meetup!
---
RT @PaaSDev
Thanks to the #ApachePinot @startreedata developer relations and community teams Thanks! @davidgsIoT #IoT #ApachePulsar #NYC #Meetup @PulsarMeetup We had some Pizza, Pulsar and Pinot. Now it's on to Princeton for the next one #ApacheNiFi. https://www.meetup.com/new-york-city-apache-pulsar-meetup/events/289674210/
https://twitter.com/PaaSDev/status/1603464100549459968

There is nothing public yet, but we are getting ready to hire in #India (Pune, I suspect). If you know technologists there with any of the following skills, have them get in touch: #kubernetes, #istio, #postgres, #apachecassandra #calico #java #apachetomcat #apachehttpd #mysql #mariadb #apachekafka #apachenifi #nomad #hadoop #janusgraph #neo4j #centos #ubuntu #linux #suse #rancher #ovirt #openstack #apachespark #angularjs #patroni #apachesolr #redis #elasticsearch #fluentd #grafana #prometheus

[1] https://mikethomsen.github.io/posts/2020/10/31/querying-a-gremlin-enabled-graph-database-with-nifi/

#gremlin #apachenifi #routing #graph

So it seems like the custom way to start writing here is about hashtags not on my profile:

#python
#vim
#neovim
#datascience
#machinelearning
#opensource
#scala
#terminal
#mac
#git
#food
#italy
#code
#softwareengineering
#dataengineering
#datapipelines
#airflow
#pandas
#numpy
#pydata
#mailmate
#apachenifi
#nifi
#godatadriven