Abstract

The expansion of large-scale databases and repositories, such as Data Lakes, has amplified the need for robust data security measures, especially concerning the privacy of sensitive information. This poster introduces an innovative proof of concept (PoC) for encrypting Chilean RUTs using format-preserving encryption (FPE) in the Databricks distributed computing environment. Our prototype demonstrates a practical approach to data encryption that maintains the original data format, thus ensuring integration in Big Data ecosystems. Our findings reveal that the encryption and decryption processes, along with data download times, scale predictably with the volume of data. These performance outcomes are encouraging, showcasing the effectiveness of FPE in maintaining both security and functionality. The successful application of FPE in this context underscores its potential as a valuable tool for secure data management in large-scale environments.