In the conduct of normal government business, communications can in most cases be classified for a period of 25 years to protect national interests. When that period expires, official documents are released unless an investigation shows they should be released. Unclassified documents are also subject to disclosure through Freedom of Information Act requests. The existing manual review process is quickly becoming untenable. To address this challenge and ensure timely release of documents, we trained a supervised open source classification model to recognize people declassification decisions between 2020 and 2021. We tested our model on cables that underwent a declassification evaluation in 2022. Our model performed with over 98% accuracy, preserving over 63% of the manual workload. Successful integration of the technology, platform and business process, which keeps people informed, drove better performance in 2023 and improved rating consistency.

Lecture by: Samuel Stehle, data scientist, US Department of State

There's more to discover here:
LLM compact guide: https://dbricks.co/43WuQyb
Big book of MLOps: https://dbricks.co/3r0Pqiz

Contact us: Website: https://databricks.com
Twitter: https://twitter.com/databricks
LinkedIn: https://www.linkedin.com/company/data…
Instagram: https://www.instagram.com/databricksinc
Facebook: https://www.facebook.com/databricksinc

Please take the opportunity to connect and share this video with your friends and family if you find it helpful.