A pipeline pulls customer addresses from three source systems that each store state names differently: ‘California’, ‘CA’, and ‘06’. Which Transform operation should be applied?

Question

BlackTom AI · Accepted Answer

Normalization/standardization — map all variants to a single consistent representation is the appropriate Transform operation.

Relevant knowledge points and concepts:
- Data normalization/standardization (also called canonicalization) converts heterogeneous representations of the same entity into a single agreed-upon format (controlled vocabulary).  
- Common address fields (state) are often stored as full names, postal abbreviations, or numeric codes (e.g., FIPS). A mapping/lookup table or transformation function is used to reconcile these.  
- Other transform categories (type casting, feature engineering, deduplication) serve different purposes and do not reconcile semantic variants.

Step-by-step reasoning and intermediate mapping:
1. Identify input variants for the state field: "California", "CA", "06". Recognize these represent the same state (06 is the FIPS code for California).  
2. Choose a target canonical representation (example: USPS two-letter code "CA" or full name "California"). Suppose we choose "CA".  
3. Build a mapping table (lookup):  
   - "California" -> "CA"  
   - "CA" -> "CA"  
   - "06" -> "CA" (if incoming is numeric string, strip leading zeros or map "06" explicitly)  
4. Apply transformation: for each record, normalize casing/whitespace, then lookup the canonical value and replace the stored value with "CA". Records not found in the lookup are flagged for review.

Why the correct answer is correct:
- The problem requires unifying different textual and coded representations into one consistent form. That is the precise goal of normalization/standardization. A lookup or mapping routine will ensure all three source formats are represented identically downstream.

Why other options are incorrect:
- Data type casting — converting string to integer would not reconcile "California" or "CA" to the same form; it only changes datatype.  
- Feature engineering — creating a derived column is for predictive features, not for harmonizing existing semantic values.  
- Deduplication — removes duplicate records but does not map different representations of the same value to a single representation.

Conclusion: The correct Transform operation is "Normalization/standardization — map all variants to a single consistent representation," which matches the provided answer.

A pipeline pulls customer addresses from three source systems that each store state names differently: ‘California’, ‘CA’, and ‘06’. Which Transform operation should be applied?单项选择题

类似问题

You are preprocessing a dataset for a machine learning model and decide to apply normalization. Which of the following statements about normalization are correct? (Select all that apply.)

Normalization is especially important before non-linearity such as sigmoid or tanh

Question at position 8 An excess of growth hormone (GH) before puberty can result in the development ofgigantism.Graves' disease.acromegaly.pituitary dwarfism.Clear my selection

Question at position 6 The most abundant supporting cells in the central nervous system are called Question Blank 1 of 1[input].

Question at position 5 In the eye, the lens functions tofocus light on the retina at the back of the eye.protect the surface of the eye.increase vision in low-light conditions.move the eye side to side.Clear my selection

Question at position 4 Olfactory (odor) receptors are chemoreceptors. TrueFalse

If the pKa of HCHO2 is 3.74 and the pH of an HCHO2/NaCHO2 solution is 3.00, which of the following is TRUE?

Identify the missing particle in the following nuclear equation: 92 236 𝑈 → 38 90 𝑆 𝑟 + ? + 2 0 1 𝑛 + 4 0 0 𝑔

更多留学生实用工具

智能学习助手

风格化写作助手

论文查重助手

文献引用助手

课堂转译助手

课堂笔记助手

Quiz搜索助手

学校历年真题

智能刷题助手

智能匹配练习

希望你的学习变得更简单