How messy is #terraform with #gcp?

I'm trying to make a system where #rust worker ingests data of HTTP requests via #cloudrun, and passes them into #bigtable, which uses further ingestion recipe to export the data into #bigquery

I have tried to make a complete terraform declaration for this, but got into permission issues, then I have tried to make a system that generates all the artefacts like service accounts and docker image and then refers to those from terraform builds, but I almost don't see a value of doing it like that.

Does anyone have an example of #cloudrun #cdc? I am new to this and I feel really slow.

#lazyweb #askfedi

Help needed! I'm writing a media theory book chapter about Hadoop, BigTable, ACID, BASE and CAP for a non-technical audience. I'm looking for an _expert_ and practitioner from the field to doublecheck the 11 pages I wrote. Thank you for boosting. #phd #academia #Hadoop, #BigTable

"#Bigtable [...] had these internal control-plane entities (as part of the implementation) called tablet servers, which had large indexes, and at some point they became a scaling bottleneck. So the Bigtable engineers scratched their heads over how to make it scale, and realized that they could replace the tablet servers with Bigtables to unblock the scaling. So Bigtable is part of its own implementation. It’s Bigtables all the way down" https://steve-yegge.medium.com/dear-google-cloud-your-deprecation-policy-is-killing-you-ee7525dc05dc #Google

Excited to share my latest technical article on how we implemented our in-house segmentation engine at Sendinblue using Go Lang! With a focus on maximizing performance, we utilized MongoDB, Clickhouse, and BigTable to process large amounts of data using fine-tuned algorithms.

Take a look and let me know your thoughts in the comments!

https://engineering.sendinblue.com/segmentation-to-target-the-right-audience/

#golang #mongodb #clickhouse #bigtable #dataprocessing #algorithms #performance

@coderbyheart

I think the ship has sailed on there being one true definition of #serverless. The industry has co-opted that term for any product they create that cuts back on administrative duties.

For example, I've used #Bigtable on #GCP. It's instance/node-based and you pay a flat rate per month just to get one node running, even before you put anything on it. But, once it's running, it's quite low effort to use.

I'd compromise and call stuff like that "managed" though.

Fraud is a real problem with significant impact on business. It just feels really awful to have something you've created abused by someone trying to work the system.

Check out how #Bigtable and #GoogleCloud can be used to spot when someone's not being entirely honest.

https://www.youtube.com/watch?v=L44LKFUs_dg

Understanding HBase and BigTable
https://dzone.com/articles/understanding-hbase-and-bigtab
#hbase #bigtable #bigdata