The DataFitness ControlOne Agent is already doing its job of collecting vast amounts of data for about three years. The first ‘official’ commit to the Dataether DataFitness repository was on the day after my birthday in November 2020, and before that there were some initial versions stored in my private repos.
We have been tracking data developments over time at one company for close to two years know, really disclosing interesting insights and monitoring information fit for governance and general data management purposes.
Also, the collected data can be used in many different ways, including full-text fuzzy search and vector search (or ‘hybrid search’ as the combination is called nowadays), delivering additional information that can be fed back into the company for direct action. We even did a first successful test creating executable scripts for mass data movements based on customer driven rules and decision criteria (yes, the scripts were actually executed).
Development on the Agent is still ongoing. A small list of recent changes:
- Updated Tika to version 2.8.0, this should give more detail on geospatial data. Some fixes to deal with the extracted data in a better way.
- Adjusted Dataether company and DataFitness product names to latest naming conventions. And replaced the ASCII art logo in the macOS and Linux installer with the new one (thanks https://ascii-generator.site/).
- Updated all Python requirements so using latest safe modules to reduce vulnerability (thanks Snyk).
- Better Better exception handling an logging when decrypting data to import into the persistent data layer. Still happily using MongoDB Atlas.
- Some fixes to improve string handling in Windows and more.
The backlog still has over 100 tickets for further improvements so more to do for sure ¯\_(ツ)_/¯
One Reply to “Some updates”