A company gathers data from many sources into an S3 bucket, runs an AWS Glue ETL job to transform it, and stores the transformed output in an S3-based data lake queried by Amazon Athena. The company needs to identify matching records even when there is no shared unique identifier. Which solution will accomplish this?
Choose an answer
Tap an option to check your answer.
Correct answer: Train and use the AWS Lake Formation FindMatches transform in the ETL job..
Why this is the answer
The correct answer is to train and use the AWS Lake Formation FindMatches transform in the ETL job. FindMatches is specifically designed for identifying duplicate or matching records in a dataset even when there's no common unique identifier. It uses machine learning to learn patterns and similarities, making it ideal for fuzzy matching scenarios. Amazon Macie is a data security and privacy service that uses machine learning to discover, classify, and protect sensitive data. It's not designed for record matching across datasets. Training and using the AWS Glue PySpark Filter class would allow you to filter data based on specific conditions, but it doesn't provide the fuzzy matching capabilities needed to identify records without a shared unique identifier. This would require explicit, exact match criteria. Partitioning tables and using the ETL job to partition the data on a unique identifier is a data organization strategy for improving query performance, not a method for identifying matching records when a unique identifier is absent.
Pass your exam — without the endless answer hunt
Get every verified question and explanation for this exam in one place, and save hours of prep. 1,000+ certifications · 20+ languages · free to start.
Pass your exam faster → No card needed