Optimizing foundation modelsFull notesSummaryRingkasanStoriesPracticeModel Evaluation9 exam-style questions on this lesson.Question 1 of 9A team evaluates AI-generated summaries and wants to know how much of the important information from the reference summary was captured. Which metric fits?ABLEUBPerplexityCBERTScoreDROUGECheck answerQuestion 2 of 9Which metric focuses on precision and includes a brevity penalty for overly short output?ABLEUBROUGECBERTScoreDF1 scoreCheck answerQuestion 3 of 9A model writes "The automobile is quick" where the reference says "The car is fast". Which metric is most likely to recognize these as equivalent?AROUGE-2BBERTScoreCBLEUDROUGE-1Check answerQuestion 4 of 9Which ROUGE variant measures the longest common subsequence, reflecting coherence and order?AROUGE-NBROUGE-2CROUGE-LDROUGE-1Check answerQuestion 5 of 9What does ROUGE-2 measure?AOverlap of single wordsBSemantic similarity with embeddingsCPerplexityDOverlap of word pairs (bigrams)Check answerQuestion 6 of 9What is a limitation of ROUGE and BLEU?AThey penalize valid paraphrasesBThey can only be used for image captionsCThey can't compare output to a referenceDThey require human graders for every outputCheck answerQuestion 7 of 9. Select two.Which TWO statements about BERTScore are correct? (Select TWO.)AIt includes a brevity penaltyBIt's based only on exact word matchesCIt's used only for imagesDIt uses contextual embeddings from BERTEIt measures semantic similarity with cosine similarityCheck answer0 of 2 selectedQuestion 8 of 9. Select two.A company is evaluating machine translation output against human reference translations. Which TWO metrics can it use? (Select TWO.)AMean squared errorBAUC-ROCCBLEUDROUGEER squaredCheck answer0 of 2 selectedQuestion 9 of 9In the fashion retail case, why did the company care about ROUGE, BLEU, and BERTScore?ARegulators required them for fashion retailersBBetter text moved conversion, order value, and retentionCThey replaced the need for business metricsDThey reduced the GPU costs of the modelCheck answerFine-Tuning10 exam-style questions on this lesson.Strategic Guidance for Security, Governance, and Compliance7 exam-style questions on this lesson.