@kajer you need pipeline but also real time sentiment ranking, checksums for all files seen, cve, ioc - all of a sudden you went from stodgy siem to real world noc
i like the topic even though i do look at it sarcastically
i think you want combinatorials of top 10 db and real time #mentions I think you are going to get people in federated enclaves to join together and work on problems but also make a typical image - everybody can optimize and get vbetter by sharing there will be a representative manifest of sw that will vary by sector #thomas register ocr scan and convert into semantic/vectordb/graphs #rss #solr #keywords #page rank...it reminds me of the site that correlates ip to domains and more - great osint info if found to be true - how do you advertise and make the site have rev streams - you cab advertise to people trolling the sector - you need a template bots and spiders, get all the info you can and cache sites and then get it into a db - the real time part is basically a tagcloud #i ching #book of changes #backlinks