Search Quality Rater
1. For the query [piano lessons], English (US), which of the following results should be
rated Fails to Meet? Select all that apply.
a. A list of community piano schools in the US – False
b. A result with info on raters for ballet and modern dance classes – True
c. A result about the piano dept. of a well-known music school – False
d. An article with recommendations on the best age for children to start taking
piano lessons – False
2. Which of the following is true? Select all that apply.
a. A satisfying and complete result for a broad info query can be Fully Meets – True
b. For a Know Simple query, a Fully Meets rating can be given if the result does not
display the answer, but it is at the very top of the landing page – False
c. A common interpretation for a non-visit-in-person entity query can have a Fully
Meets rating – True
d. For a result to get a Fully Meets rating, the query and user must be specific, clear,
and unambiguous – True
3. Which of the following is true? Select all that apply.
a. All foreign language results should be rated Fails to Meet – False
b. Pages with porn should get the Porn flag even if the query is looking for porn
results – True
c. Porn results should never get Highly Meets or Fully Meets ratings – False
d. Porn, Foreign Language, and Did Not Load flags depend on the query. In other
words, you must think about the query when assigning these – False
4. Which of the following is true about Main Content (MC)? Select all that apply.
a. Main Content should be created with time, effort, and expertise, and should not
be copied from another source – True
b. Main Content (MC) may include links on the page – True
c. Main Content (MC) does not include features like search boxes – True
d. High quality Main Content (MC) allows the page to achieve its purpose well –
True
, 5. Which of the following is an example of a query with an explicit location? Select all that
apply.
a. [walmart boston], English (US) – True
b. [libraries in san franscisco], English (US) – True
c. [coffee shops nearby], English (US) – True
d. [best buy in New York], English (US) – True
6. Which of the following is true? Select all that apply.
a. Most queries have Fully Meets results – False
b. www.crocheting.com is Fully Meets for the query [crocheting] – False
c. https://www.un.org/fr/ is Fully Meets for the query [united nations], French (FR)
– True
d. www.britneyspears.com is Fully Meets for the query [Britney spears images] –
False
7. If you think the query is misspelled, which of the following should you do? Select all that
apply.
a. Assign a Needs Met rating to all results because misspelled queries don’t deserve
high Needs Met ratings – False
b. Release the task – False @
c. For obviously misspelled queries, base the Needs Met rating on user intent –
True
d. For obviously misspelled queries, assign a Low or Lowest Page Quality (PQ) rating
– False
8. Which of the following is a Website query? Select all that apply.
a. [Miami weather], English (US) – False
b. [Miami Wikipedia org], English (US) – True
c. [Miami map], English (US) – False
d. [Miami images], English (US) – False
9. Which of the following is true? Select all that apply.
a. All queries have an explicit location – False
b. The explicit location is found inside the query – True
1. For the query [piano lessons], English (US), which of the following results should be
rated Fails to Meet? Select all that apply.
a. A list of community piano schools in the US – False
b. A result with info on raters for ballet and modern dance classes – True
c. A result about the piano dept. of a well-known music school – False
d. An article with recommendations on the best age for children to start taking
piano lessons – False
2. Which of the following is true? Select all that apply.
a. A satisfying and complete result for a broad info query can be Fully Meets – True
b. For a Know Simple query, a Fully Meets rating can be given if the result does not
display the answer, but it is at the very top of the landing page – False
c. A common interpretation for a non-visit-in-person entity query can have a Fully
Meets rating – True
d. For a result to get a Fully Meets rating, the query and user must be specific, clear,
and unambiguous – True
3. Which of the following is true? Select all that apply.
a. All foreign language results should be rated Fails to Meet – False
b. Pages with porn should get the Porn flag even if the query is looking for porn
results – True
c. Porn results should never get Highly Meets or Fully Meets ratings – False
d. Porn, Foreign Language, and Did Not Load flags depend on the query. In other
words, you must think about the query when assigning these – False
4. Which of the following is true about Main Content (MC)? Select all that apply.
a. Main Content should be created with time, effort, and expertise, and should not
be copied from another source – True
b. Main Content (MC) may include links on the page – True
c. Main Content (MC) does not include features like search boxes – True
d. High quality Main Content (MC) allows the page to achieve its purpose well –
True
, 5. Which of the following is an example of a query with an explicit location? Select all that
apply.
a. [walmart boston], English (US) – True
b. [libraries in san franscisco], English (US) – True
c. [coffee shops nearby], English (US) – True
d. [best buy in New York], English (US) – True
6. Which of the following is true? Select all that apply.
a. Most queries have Fully Meets results – False
b. www.crocheting.com is Fully Meets for the query [crocheting] – False
c. https://www.un.org/fr/ is Fully Meets for the query [united nations], French (FR)
– True
d. www.britneyspears.com is Fully Meets for the query [Britney spears images] –
False
7. If you think the query is misspelled, which of the following should you do? Select all that
apply.
a. Assign a Needs Met rating to all results because misspelled queries don’t deserve
high Needs Met ratings – False
b. Release the task – False @
c. For obviously misspelled queries, base the Needs Met rating on user intent –
True
d. For obviously misspelled queries, assign a Low or Lowest Page Quality (PQ) rating
– False
8. Which of the following is a Website query? Select all that apply.
a. [Miami weather], English (US) – False
b. [Miami Wikipedia org], English (US) – True
c. [Miami map], English (US) – False
d. [Miami images], English (US) – False
9. Which of the following is true? Select all that apply.
a. All queries have an explicit location – False
b. The explicit location is found inside the query – True
