You need to merge two datasets—customer orders and product catalog descriptions—that have different structures and formats, matching similar records and removing duplicates. Which solution is the most appropriate for matching and cleansing this data?
Choose an answer
Tap an option to check your answer.
Correct answer: Run AWS Glue crawlers to populate the Glue Data Catalog and use the Glue FindMatches transform to identify similar records and deduplicate the data..
Why this is the answer
The most appropriate solution is to use AWS Glue crawlers and the Glue FindMatches transform. AWS Glue crawlers automatically infer schemas and populate the Glue Data Catalog, providing a unified metadata repository for your disparate datasets. The Glue FindMatches transform is specifically designed for identifying and linking records that refer to the same entity, even when they lack common identifiers or have inconsistencies (fuzzy matching). It uses machine learning to learn matching rules based on examples, making it highly effective for cleansing and deduplicating data with varying structures and formats. Writing a Lambda function for this task is inefficient and complex, as it would require significant custom development for fuzzy matching and deduplication logic, which Glue FindMatches handles out-of-the-box. The Glue SearchTables API is for searching the Data Catalog, not for performing fuzzy matching or data cleansing. Lake Formation custom transforms are for data access control and security, not for data matching and deduplication.
Pass your exam — without the endless answer hunt
Get every verified question and explanation for this exam in one place, and save hours of prep. 1,000+ certifications · 20+ languages · free to start.
Pass your exam faster → No card needed