Rogue - Review product search queries

 Rogue - Review product search queries - 2025

query "Yamaha Grizzly"

Q1. What is the Product – Query Relevance?

• Correct Answer: Relevant ✅

Q2. What is the Off Topic Reason?

• Correct Answer: None of the Above ✅

query "Xbox One"

Q3. What is the Product – Query Relevance?

• Correct Answer: Off Topic ✅

Q4. What is the Off Topic Reason?

• Correct Answer: Dysfunctional Product ✅

query "Sacramento"

Q5. What is the Product – Query Relevance?

• Correct Answer: Somewhat Relevant ✅

Q6. What is the Off Topic Reason?

• Correct Answer: None of the Above ✅

query "RAV4"

Q7. What is the Product – Query Relevance?

• Correct Answer: Off Topic ✅

Q8. What is the Off Topic Reason?

• Correct Answer: Product Mismatch (+ Not Reasonable Replacement) ✅

query "White Desk"

Q9. What is the Product – Query Relevance?

• Correct Answer: Off Topic ✅

Q10. What is the Off Topic Reason?

• Correct Answer: Attribute Mismatch (+ Not Reasonable Replacement) ✅

query "Road Bike"

Q11. What is the Product – Query Relevance?

• Correct Answer: Relevant ✅

Q12. What is the Off Topic Reason?

• Correct Answer: None of the Above ✅

query "Lamp"

Q13. What is the Product – Query Relevance?

• Correct Answer: Relevant ✅

Q14. What is the Off Topic Reason?

• Correct Answer: None of the Above ✅

query "Twin Bed"

Q15. What is the Product – Query Relevance?

• Correct Answer: Relevant ✅

Q16. What is the Off Topic Reason?

• Correct Answer: None of the Above ✅

query "Mercury Cyclone"

Q17. What is the Product – Query Relevance?

• Correct Answer: Somewhat Relevant ✅

Q18. What is the Off Topic Reason?

• Correct Answer: None of the Above ✅

Q19-Q20

21. TRUE/FALSE: A query asks for prohibited content, but the result does not violate. This will be skipped as a Brand Policy Violation.

✔️ Correct Answer: FALSE

22. TRUE/FALSE: Facebook Marketplace does not allow the buying or selling of animals. The intent for these queries will be products related to the animal.

✔️ Correct Answer: TRUE

23.TRUE/FALSE: For vehicles older than 5 years, the Guideline allows for results up to 5 years older or newer than the queried year to be considered reasonable replacements.
✔️ Correct Answer: TRUE

24.TRUE/FALSE: If a user searches for a primary product but receives a result showing an accessory for that product, the rating will be Somewhat Relevant.
✔️ Correct Answer: TRUE

25.TRUE/FALSE: The query is Atlanta, and the result is a car for sale in Atlanta. The correct rating is Relevant.
✔️ Corrct Answer: TRUE

26.TRUE/FALSE: Results for Services fall into the Brand Policy Violation (Violating LOW) category.
✔️ Correct Answer: TRUE

27.TRUE/FALSE: Brand Mismatches are items the searcher will not be willing to settle for because they differ by brand and too greatly by characterization to be considered reasonable replacements.
✔️ Correct Answer: TRUE

28.TRUE/FALSE: Raters should use Facebook Marketplace as the first option to conduct side searches.
✔️ Correct Answer: TRUE

29.TRUE/FALSE: The queried product and the product result belong to different and completely unrelated categories. There is no reasonable connection between them. The correct rating is Product Mismatch (+ Not Reasonable Replacement).
✔️ Correct Answer: FALSE

30.TRUE/FALSE: The query is Michael. The result is a Michael Kors handbag. The correct rating is Relevant.
✔️ Correct Answer: TRUE

Query: "Hoka"

31.What is the Product – Query Relevance?

• Correct Answer: Relevant ✅

32.What is the Off Topic Reason?

• Correct Answer: None of the Above ✅

Query: "Drill Press"

33.What is the Product – Query Relevance?

• Relevant

34.What is the Off Topic Reason?

• None of the Above

Query: "M&M Candy Dispenser"

35.What is the Product – Query Relevance?

• Correct Answer: Off Topic ✅

36.What is the Off Topic Reason?

• Correct Answer: Detrimental ✅

Query: "Free Couch"

37.What is the Product – Query Relevance?

• Off Topic✅

38.What is the Off Topic Reason?

• Exchange Term Mismatch✅

Query: "Rug"

39.What is the Product – Query Relevance?

• Relevant

40.What is the Off Topic Reason?

• None of the Above

Query: "Anderson Windows"

41.What is the Product – Query Relevance?

• Relevant

42.What is the Off Topic Reason?

• None of the Above

Query: "Area Rugs 8x10"

43. What is the Product – Query Relevance?

• Somewhat Relevant

44.What is the Off Topic Reason?

• None of the Above

Query: "Seesaw for Kids"

45.What is the Product – Query Relevance?

• Off Topic

46.What is the Off Topic Reason?

• Product Mismatch (+ Not Reasonable Replacement)

Query: "Desk Chair for Sale"

47.What is the Product – Query Relevance?

• Relevant

48.What is the Off Topic Reason?

• None of the Above

Query: "Wired Headphones"

49.What is the Product – Query Relevance?

• Off Topic

50.What is the Off Topic Reason?

• Attribute Mismatch (+ Not Reasonable Replacement)