A company is moving a large language model (LLM) from on-premises training to Amazon SageMaker for use in a live conversational system that answers real-time credit-card queries. Which SageMaker approach should be used to train and deploy the LLM?
Choose an answer
Tap an option to check your answer.
Correct answer: Use SageMaker Training Compiler to accelerate LLM training, and deploy the trained model using SageMaker real-time inference..
Why this is the answer
The correct approach is to use SageMaker Training Compiler and SageMaker real-time inference. SageMaker Training Compiler optimizes LLM training by automatically compiling and optimizing deep learning models, significantly reducing training time and cost, which is crucial for large models. Deploying with SageMaker real-time inference is essential for a live conversational system that requires low-latency responses for real-time credit-card queries. Using deep learning containers for large model inference is for inference, not training. SageMaker Notebook Jobs are for interactive development and experimentation, not optimized for large-scale, production-grade LLM training. SageMaker Asynchronous Inference is suitable for requests with larger payloads or longer processing times where immediate responses are not required, which doesn't fit a real-time conversational system. SageMaker batch transform is for processing large datasets of inferences offline, not for real-time interactive applications.
Pass your exam — without the endless answer hunt
Get every verified question and explanation for this exam in one place, and save hours of prep. 1,000+ certifications · 20+ languages · free to start.
Pass your exam faster → No card needed