What is the recommended way to remove PII or payment card data from customer support logs before initial storage in Cloud Bigtable?

The Cloud Data Loss Prevention (DLP) API is the recommended and most robust solution for identifying and de-identifying sensitive data like PII and payment card information. It offers pre-built detectors for various sensitive data types, including credit card numbers, email addresses, and phone numbers, and provides methods like tokenization, redaction, and masking for de-identification. Hashing all data with SHA256 would make it unreadable and unusable for customer support, and while it obscures the original data, it doesn't allow for partial de-identification or analysis. Encrypting all data with elliptic curve cryptography would also make the data unusable for direct support purposes without decryption. Using regular expressions is a manual and error-prone approach; it's difficult to maintain and may miss new or evolving patterns of sensitive data, making it less reliable than a dedicated DLP solution.