anybody know if it is ok to run #apachespark and #apachehive on the same box? I have 969 #java processes on this #centos box, which seems like a lot, but not sure if it is actually a problem.

Something is certainly a problem.

#bigdata

👩‍💻 Hands-On with Catalogs in Flink SQL

🔧 In this second post in the series, @rmoff shows how to use Flink SQL with catalogs including #apacheHive, #JDBC, & #apacheIceberg. It also includes a closer look at the data structures within the Hive Metastore.

https://dcbl.link/flink-catalogs---2

#dataEngineering #streamProcessing #SQL #openSource

#hiveql #sql #apachehive
Question: why do I lose records in my results when I try to use date_format(field_name) on a result field?

The field in the table is a TIMESTAMP, so I used to_date(field_name) but that gives me yyyy-MM-dd and I need MM/dd/yyyy format.

EDIT: Without date_format the records all show up. With date_format some records disappear from the results.