Please ensure that you are using the latest version of the guidelines from BaseLine, which

are found in the upper right corner of every task.

Guidelines for Search - Video Hints

2 l
53 tia
Table of Contents
Please ensure that you are using the latest version of the guidelines from BaseLine, which are found in the upper
right corner of every task. ............................................................................................................................................. 1

Guidelines for Search - Video Hints......................................................................................... 1

Introduction.................................................................................................................................................................... 3

99 n
What is a search hint?.................................................................................................................................................... 4
Hint types .................................................................................................................................................................. 4
e
The purpose of video search hints evaluation................................................................................................................ 5

Mandatory Comment .................................................................................................................................................... 6

Rating Scale ................................................................................................................................................................... 6

11 id
Ratings Overview .......................................................................................................................................................... 7

Examples for different ratings........................................................................................................................................ 9

Perfect ....................................................................................................................................................................... 9

Good ........................................................................................................................................................................ 10
nf

Acceptable ............................................................................................................................................................... 12

Unacceptable: Spelling ............................................................................................................................................ 14

Unacceptable: Other ............................................................................................................................................... 14

Unacceptable: Extra Language [Removed] ............................................................................................................. 15

Co

Problem: Other........................................................................................................................................................ 15
Additional Guidelines for Japan .................................................................................................................................. 16
Non-Japanese Content/Cast ................................................................................................................................... 17

Japanese Content/Cast ........................................................................................................................................... 17

 [01.27.23] Update: ‘Unacceptable: Extra Language’ removed from the rating scale. Examples
added to ‘Unacceptable: Spelling’. Info added for explicit content under ‘Unacceptable: Other’.
[01.06.23] Update: Added 'character' to the other possible hint types to 'Other hint types'.
[01.03.23] Update: More info added to the ‘Relevance’ section.

2 l
[12.21.22] Update: Section for ‘Seasonal Results’ added for holiday queries.
[12.12.22] Update: Changed the rating and reasoning for example 'Grease 2'.

53 tia
[11.08.22] Update: Additional info added to market. Examples added to Unacceptable: Spelling
and Other, and sports team example with the rating Good.
[10.28.22] Update: More info added about content that can be considered "classic".
[09.02.22] Update: New examples, additional guidance added overall on the purpose and rating
of video hints. Additional guidelines for Japan added.

99 ne
11 id
nf
Co
 Introduction
In this document we will explain how to evaluate video search hints. You will use
the BaseLine tool to make these judgments.

2 l
53 tia
99 ne
11 id
nf
Co

Search hints are shown before the Top

Results
 What is a search hint?

A hint is a suggestion that the search engine is offering to the user as they start typing their

2 l
query.
The hint is not a search result, It is a query by itself.

53 tia
Examples:
Input: 'ab' -> Hint: 'abraham'
Input: 'the' -> Hint: 'the morning show'
Input: 'the' -> Hint: 'the simpsons'
Input: 'dis' -> Hint: 'disney'

99 n
Hint types
For video search we offer several types of hints:
e
Content title
11 id
A search hint that suggest a specific movie or TV show
Input: 'cin' -> Hint: 'cinderella'
Input: 'lit' -> Hint: 'little einsteins'

In case of a series, the hint can point to part of the title and not a specific title.
nf

Input: 'st' -> Hint: 'star wars'

Person - Cast and Crew

A search hint that suggest a a person. It could be an actor or actress, or any other cast and crew
Co

member.

Input: 'leo' -> Hint: 'leonardo dicaprio'

Input: 'que' -> Hint: 'quentin tarantino'

Other hint types

A search hint that suggest video related terms like: channel, genre, franchise name, characters,
awards, topic, etc.

Input: 'an' -> Hint: 'animation'

Input: 'os' -> Hint: 'oscar'
Input: 'hb' -> Hint: 'hbo'
 A search hint that suggests a combination of video related terms like: channel + genre, channel
+ content type, genre + content type, channel + genre + content type.

2 l
Input: 'an' -> Hint: 'animation series'

53 tia
Input: 'os' -> Hint: 'oscar winner: best actor'
Input: 'hb' -> Hint: 'hbo max originals'

The purpose of video search hints evaluation

99 n
The purpose of this evaluation is to evaluate the relevance of a search hint for a given input.
We want to ensure that the hints add value to the users in their search journey and the hint is
relevant to the input given by the user.
A video search hint should help the user find a TV show, a movie, an actor/actress, or any other
e
video related content.

Use your best judgment and try to assess if the hint can be used as the primary or secondary
11 id
intent for the given input, and consider the popularity, relevancy and recency of a suggestion.
Some inputs map to a larger catalog of content than others. Take into account the length of the
string and how strong the intent is.

For example, the input ‘th’ has many more possible hints compared to the input ‘zi’, and ‘h’ has
many more possible hints than ‘hbo’. You should adjust your popularity/recency judgement
nf

according to the set of content which is available given an input.

To help you find out if a hint has video context and can be the primary or secondary intent of
the input we added links to the task page that will point you to popular search and video
content websites. It is always good to check more than one source when deciding on the rating.
Co

E3696F23-639A-437D-BB52-07C48FF21CF7_4_5005_c.jpeg 22.6 KB

For example:
Input: 'bar' -> Hint: 'bar rescue'
 Clicking on the IMDB link https://www.imdb.com/find?q=bar+rescue will reveal that
there is an ongoing TV series from 2011 called 'Bar Rescue', hence this hint has a relevant video
related context.

2 l
Input: 'bar' -> Hint: 'barkskin'
Clicking on the Google play

53 tia
link https://play.google.com/store/search?q=barkskins&c=movies&hl=en&gl=us will reveal that
there is a TV series from called 'Barkskins', hence this hint has a relevant video related context.

Mandatory Comment
Each rating must be explained in the comment box, even if “optional” is indicated

99 n
— rating comments are always mandatory. The comment should be concise and must only
explain why the rating chosen is the correct one in application of the guidelines.
e
Rating Scale
The grades on the relevance scale are as follows:
Perfect
11 id
Good
Acceptable
Unacceptable: Spelling
Unacceptable: Other
Problem: Other
nf

When choosing your rating take into consideration the following

Relevance to the input
Recency of the video content hinted
Popularity of the video content hinted
Co
 Ratings Overview

Primary and Secondary Intent

2 l
The primary intent of a query is based primarily on relevance, and you should place strong

53 tia
emphasis on the recency and popularity on the content you are evaluating.
A secondary intent, on the other hand, may be less relevant, less popular and/or less recent
intent that is relevant to the input. This can be different than the primary intent, e.g., if the
primary intent is clearly a TV show, but the same query could have a secondary intent for
example for Channel category.

Relevance

99 n
Relevance captures the relationship between the literal text of the query and the hint.
Please consider how you would search for content as a user of a video streaming platform.
Typically, a user’s query matches the start of a title, but not always. Hint is only relevant for
e
notable/memorable parts of the title, how someone would refer to the content. Not all
secondary titles (after colons), or random matching keyword to middle of string are considered
relevant.
11 id
For example, a user may start their query with ‘sorc’ when the intent is ‘Harry Potter and the
Sorcerer’s Stone’.

Popularity/Recency
nf

Please consider popularity/recency in relation to other hints possible for a given

query. Popularity of content should be evaluated in the context of today — typically newer
content is more popular today.
However, a film which was very popular 20 years ago may be a “classic” and still popular today,
in which case it is eligible for a high rating. However, moderately popular films which are not
recent should be rated lower. Ignore recency for classic movies and tv shows that were among
Co

the most popular in the decade they were released or have high popularity even today.
The popularity of very new content will often be somewhat unclear or appear unpopular by
metrics such as IMDB reviews. Please consider some of following factors when considering
popularity of new content.
• Is the content part of a popular franchise?
• Is the content being widely advertised? Have a large number of people watched the
trailer?
• How well did it perform in the box office, globally and locally?
• How popular is other content produced by the same Studio or for the same Channel?
 Market
Local market should be considered in ratings, a hint may point to something that is no that
popular worldwide but very popular in the local market.
• For example, for the query ‘s’, the hint ‘ski’ would likely be Acceptable in the US

2 l
storefront as the sport is less popular, however, in the Norwegian storefront it would

53 tia
be Perfect as the sport is extremely popular and many users would want related
content.
• The video hint provided should also match the title used in the market. If we are
returning a wrong market video hint, the rating should be demoted by one step. For
example:
o ‘bri’→ ‘the great british baking show“: Perfect for the US market.
o ‘bri’→ ‘the great british bake off’: Good for the US market since this is the

99 ne
Articles
UK title for this TV show.
• However, if the user is searching in English in non-English markets, returning English title
would not be demoted. For example:
o ‘snow’ → ‘snow white and the seven dwarfs’: Search query is in English,
returning a very relevant English result for very popular classic is Perfect.
11 id
You may choose to ignore ‘the’ at the start of the hint. For example, the input query ‘sim’ is
highly relevant to the hint ‘the simpsons’.
However, when the query input is like ‘t’ , ‘th’, ‘the’, ‘a’, etc., this is important to determine
relevance.
nf

Misspelled query
When rating, take in consideration that the search query might be misspelled. In cases where
the intent of the query is clear also if the query is misspelled, a suggestion that points to the
primary/secondary intent content should be rated as Perfect/Good/Acceptable.
Co

• For example, for the search query ‘gost’, the correctly spelled suggestion ‘Ghostbusters:
Afterlife’ should be rated as Perfect.
• Similarly for the query ‘rhe’, hints starting with ‘the’ could be considered as the primary
intent

Seasonal Results
In some locales there are seasonal results which have additional relevance and popularity at
specific times of year, for example holiday movies are very popular in the US at the end of the
year. Please consider the seasonal popularity when rating results and consider increasing the
rating due to seasonal popularity.

Examples:
 • [s] → “Spirited”: Always Perfect, new and very popular result, relevant to the input.
• [c] → “A Charlie Brown Christmas”: If rating the result in July this would be a Good result
as it is relevant and popular, but not quite at the level of a classic that would receive a
perfect rating. However, if this result surfaces in the November / December

2 l
timeframe it should be rated as Perfect as it is a holiday classic and a perfect result at
that time.

53 tia
• [bo] → “A Boyfriend for Christmas”: If rating in the summer this would be an Acceptable
result, it is relevant but not recent or popular. During the Holiday season it would be
rated as Good, being a Christmas Romantic Comedy, it has additional popularity
during that period.

Examples for different ratings

99 n
Perfect
A suggestion that very likely satisfies a common primary intent of the input.
e
Perfect suggestions complete the query, are mainstream popular, add value, and “make sense”
given the length of the string.
11 id
Keep in mid that incomplete queries can have more than one possible primary intent. All the
hints that complete and/or are strongly related to the query and that point to possible primary
intents should be rated as Perfect.
• For example, for the query ‘av’, possible hints that should be rated as Perfect are
‘avengers’, ‘avatar’, ‘avengers: endgame’, ‘avatar: the way of water’.
nf

Examples of Perfect hints:

Content Title
• 'grea' → 'grease': High relevance, popular content, can be considered a classic, very
likely to satisfy a primary intent.
Co

• 'grea' → 'the greatest showman': High relevance, popular content, very likely to satisfy a
primary intent.
• ‘rise’ → ‘star war: episode IX - the rise of skywalker’: Popular movie from 2019, high
relevancy to the users. It could be very possible that the user would search this
content with the last part only, and not the full name with the movie series name.
• 'under' → 'underwater': Popular movie from 2020, likely to satisfy a primary intent.
• 'atlanta' → 'atlanta': Popular TV series, premiered in 2016. Likely to satisfy a primary
intent.
• mo’ → ‘the morning show’: Popular and recent, ongoing TV series.
• ‘par’ → ‘parks and recreation’: High relevance, popular TV show, likely to satisfy primary
intent.
• 'star' → 'star wars: the clone wars': Popular and very likely to satisfy a primary intent.
 • ‘dark’ → ‘the dark knight’: High relevance and very popular film. Release in 2008 but
remains popular (2.5M IMDB Reviews).
• ‘casa’ → ‘casablanca’: High relevance and very popular movie. Not recent (from 1942),
but considered a classic.

2 l
• ‘t’ → ‘ted lasso’: Very popular and recent, ongoing, tv show.
• ‘t’ → ‘top gun’: Very popular and recent movie.

53 tia
• ‘rack p’ → ‘the rack pack’: Unpopular and not particularly recent (2016), however, it is
the most recent and popular suggestion that is relevant to the query, making it the
primary intent.

Person – Cast & Crew

• ‘kathr’ → ‘kathryn bigelow’: Academy Award winning director with numerous popular
films.

99 n
Other
• ‘bige’ → ‘kathryn bigelow’: Academy Award winning director with numerous popular
films.
• ‘leo’ → ‘leonardo dicaprio’: Very popular actor with numerous leading roles in big hits.
• ‘leti’ → ‘letitia wright’: High relevance and stars in hugely popular Black Panther movies.
e
• ‘cri’ → ‘crime’: Popular genre with high quality, popular, and recent content available.
11 id
• ‘mar’ → ‘marvel’: One of the most popular studios with recent content available.
• ‘apple’ → ‘apple tv+’: Apple streaming service channel, high relevance, popular, recent
content.
• 'dis' → 'disney': Popular network offering original content.
• ‘hb’ → ‘hbo max’: Streaming service with lots of popular content.
nf

• 'hbo max' → 'hbo max originals': Intent for HBO Max content clearly established,
channel has many extremely popular pieces of original content that could satisfy a
primary intent.
• ‘foo’ → ‘football’: Extremely popular sport, whether American football or international
football, that is relevant and likely to fill a primary intent.
• ‘ww’ → ‘wwii’: Important historical event with lots of popular, related video content.
Co

You may encounter cases where the hint is identical to the input, and complete. The rating for
these cases should be Perfect.
• 'glee' → 'glee': Popular and very likely to satisfy a primary intent.

Good
A suggestion that is relevant and likely satisfies a secondary intent of the input.

A secondary intent is less likely intent compared to a primary one. A secondary intent hint
could be:
• Less popular: Hint that points to lesser known content.
 o A less popular suggestion might be ‘ncis: new orleans’ for the query ‘ncis’.
The primary intent of the query is the original ‘ncis’ series and there is also a
more popular spinoff ‘ncis: los angeles’ and this suggestion points to a less
popular spinoff content ‘NCIS: New Orleans’.

2 l
o Another example of less popular suggestion is ‘house hunters international’
for the query ‘hou’. The primary intent is likely the TV shows ‘House of the

53 tia
Dragon’, ‘House of Gucci’, or ‘House’, and this hint points to a less popular
TV show.
• Less recent: Hints that points to a less recent content.
o A less recent suggestion might be ‘star wars: episode ii — attack of the
clones’ for the query ‘star wars’. The primary intent is likely the more recent
movie ‘star wars: episode ix — the rise of skywalker’ (2019), or one of the
recent and popular TV shows such as ‘obi-wan kenobi’ (2022) and the hint

99 ne points to the less recent ‘Star Wars: Episode II’ (released in 2002). The more
popular movies from the original trilogy (Star Wars IV → VI) could be
considered for a Perfect rating as well.
• Slightly Specific: Hint that points to content that is relevant to a smaller group of users
than for the primary intent or that restricts the intent.
o A slightly specific suggestion might be ‘disney+ romance’ for the query is
‘roma’. The suggestions point to a specific content provider for the
11 id
‘romance’ genre that may not be applicable for all users.

Examples for hints rated Good:

Content Title
nf

• 'atlanta' → 'the real housewives of atlanta': Long-running reality TV series, but not very
popular. Likely to satisfy a secondary intent.
• 'food' → 'food paradise': Popular but not recent. Strong relevance to the input query.
Likely to satisfy a secondary intent.
• 'grea' → 'grease 2': High relevance, somewhat popular content but dated. This sequel is
not considered a classic, likely to satisfy a secondary intent.
Co

• 'par’ → ‘party of five’: Somewhat popular TV show (1994-2000), however not

considered a classic.
• 'under' → 'under the dome': Popular but not very recent (series ran for just two years
between 2013-15). Likely to satisfy a secondary intent.
• ‘dark’ → ‘dark skies’: Relevant to query, somewhat popular (75k IMDB Reviews),
somewhat recent (2013).
• 'defend' → 'defendor': Strong relevance to the input query. Popular but not recent.
Likely to satisfy a secondary intent.
• ‘mont’ → ‘montana story’: Recent (2021), but not popular. Likely to satisfy a secondary
intent.
• ‘20’ → ‘20,000 leagues under the sea’: Fairly popular, not recent (1954), but considered
a classic.
• ‘t’ → ‘ted’: Popular but not so recent (2012).
 Person – Cast & Crew
• ‘ja’ → ‘james may’: Co-host of popular Top Gear show but other more popular content is
available for ‘ja’.

2 l
• ‘mar’ → ‘margot robbie’: Popular actress and producer who won many awards in recent
years. Since there is a lot of other popular content is available for the query ‘mar’, this

53 tia
would receive a “good” rating despite the actress’ popularity.
• ‘k’ → ‘kathryn bigelow’: Famous director, however, there is lots of possible and popular
content for this query ‘k’ so the hint would only receive a ‘good’ rating.

Other
• ‘ac’ → ‘disney+ action’: Very popular genre and streaming service but suggestion is
overly specific for the query.

99 ne • ‘apple’ → ‘apple tv+ comedy’: Popular streaming service but genre addition is slightly
specific.
• ‘apple’ → ‘apple event’: Apple events are popular but not as likely of an intent as Apple
TV+.
• ‘hb’ → ‘hbo max originals’: Popular channel, but there are other less specific hint
available for this query, this is slightly specific.
• ‘dr’ → ‘uk drama’: Slightly specific addition to the genre drama when there is lots of
11 id
popular potential hints.
• ‘s’ → ‘slasher’: Slightly specific horror sub-genre for a query where there is lots of
popular and recent content.
• ‘hawa’ → ‘hawaii rainbow warriors’: Very relevant to the query, the user could be
searching results for this sport topic. There would be other popular content available,
nf

this slightly specific topic would get a rating of ‘Good’.

• ‘n’ → ‘nature’: Popular topic, but other more popular hints available and less likely to
fulfill primary intent.

Acceptable
Co

A suggestion that may be incomplete, too vague, too specific, or unpopular, or it doesn't have a
strong relevance to the input query.

• Poorly related: A suggestion is consider poorly related to the search query if it points to
a content that unlikely users would look for with that search query.
o For example, the suggestion ‘star trek: first contact’ for the search query
‘cont’. It is unlikely that the users would search this content with ‘cont’.
More likely the user was looking for the movies ‘The Contractor’, ‘Contact’
or ‘Contagion’.
• Incomplete: A suggestion is considered incomplete when it does not contain the full
content title/name.
 o For example, the suggestion ‘john carpenter’s escape’ for the search query
‘john’. The title is incomplete, the complete hint would be ‘john carpenter’s
escape from l.a.’
• Unpopular: A suggestion that is related to the search query but points to an unpopular

2 l
piece of content should be rated as Acceptable. Unpopular content can be an
unpopular movie, TV series, genre, actor/actress etc.

53 tia
o For example, the suggestion ‘mad buddies’ for the search query ‘mad’. In
this case, there would be multiple more popular intents for the query, such
as ‘Mad Max: Fury Road, ‘Mad Men’, ‘Madam Secretary’, ‘Madagaskar’ etc.
• Too vague/too specific: A suggestion that is overly vague or specific.
o For example the suggestion ‘TV show’ for the search query ‘sh’. The query is
overly vagues, the intent would likely be TV series like ‘Shameless’,
‘Sherlock’, ‘The Shrink Next Door’ or movies like ‘Shrek’.

99 ne o For example the suggestion ‘disney+ action short films’ would be overly
specific for a query ‘dis’, when less specific suggestions for ‘disney+’,
‘discovery+’ would be more popular suggestions.

Examples of Acceptable hints:

Content Title
11 id
• 'archer' → 'judge archer': Low relevancy to the input. Not recent and popular content.
• 'atlanta' → 'little women atlanta': Low relevancy to the input. Not recent nor very
popular.
• ‘sa’ → ‘sabrina, the animated series’: Not recent nor popular, TV series that ran only
from (1999-2000). (Unavailable in Apple TV, but that should not affect the rating.)
nf

• 'under' → 'k.c. undercover': Low relevancy to the input. Lacking in popularity and
recency compared to other possible hints for ‘under’.
• 'faceb' → 'why I'm not on facebook': Low relevancy to the input. Not recent and not
popular.
• ‘cri’ → ‘donald cried’: Not so popular, not recent, and not very relevant to the query.
• ‘mar’ → ‘mars needs moms’: Not recent and not a popular movie given the age.
Co

• ‘rac’ → ‘the rack pack’: Not a recent movie (from 2016) nor popular.
• ‘par’ → ‘wicker park’ - This film was popular when released but not anymore. User’s
searching for this film are likely to know the title as a whole. More relevant results
exist for ‘par’ or even ‘park’.
• ‘t’ → ‘they came together’: Not so recent (2014) and many more popular hints possible.

Person – Cast & Crew

• ‘mo’ → ‘mo trunzo’: Actress is not well known with few credits.
• ‘nic’ → ‘nick swanson’: Primarily a supporting actor whose biggest films are not recent
and many more popular and recent hints are possible.
• ‘nic’ → ‘nic mathieu’: Director with only one credit for a moderately popular film from
2016.
 Other
• ‘dr’ → ‘korean romance drama’: Hint is overly specific and not very relevant to the
query.
• ‘mou’ → ‘mountain bike downhill’: Hint points to an overly specific topic with many

2 l
other more popular and relevant hints possible.
• ‘mo’ → ‘movie’: Hint is too vague.

53 tia
• ‘so’ → ‘1994 soccer world cup’: Hint is overly specific and refers to an event that
happened a long time ago.

Unacceptable: Spelling
A suggestion that contains spelling errors, spacing errors, punctuation errors, etc. Please note
that capitalization does not matter in the context of this evaluation.

99 n
Should you be unsure if a suggestion should fall into this category, it is better to be more critical
and use this rating than not. Please add the correctly spelled title/name to the comments.

Example:
e
• 'wrath' → 'wrath of the minitaur': The correct spelling is 'wrath of
the minotaur' (misspelling).
• ‘pen’ → ‘penelope cruz’: The correct spelling is ‘penélope cruz’ (accent missing).
11 id
• 'ja' → 'peter jacksons middle earth': The correct spelling is 'Peter Jackson's middle earth'
(special character is missing).
• 'x' → 'x men': The correct spelling is x-men (special character is missing).
• ‘res’ → ‘resident evil the final chapter’: The correct spelling is ‘resident evil: the final
chapter’ (special character is missing).
• ‘rom’ → ‘romeo juliet’: The correct spelling is ‘romeo + juliet’ (special character is
nf

missing).
• ‘hot’→ ‘hot shots’: The correct spelling is ‘Hot Shots!’ (special character is missing).
• ‘apple’ → apple tv plus: The correct spelling is ‘apple tv+’ (written text instead of correct
special character).
• 'marry me' → '[marry me': Character '[' at the beginning of the hint which is not part of
Co

the title (extra character).

Unacceptable: Other
This rating should be used for any other issue you may encounter where the output is not a
suitable suggestion for the input. For example when the output is not relevant to the query,
points to non existent content, or the content is not video related (content title, cast and crew,
channel, genre, award, etc.)

For example:
• Output is irrelevant to the input
o 'i' → 'frozen ii': The hint is not relevant to the query. User would not search
this content with 'i', but most likely with a query starting with 'f'.
 o 'i' → 'spies in disguise': The hint is not relevant to the query. User would not
search this content with the preposition 'i', but most likely with a query
starting with 's'.
o 'avata' - 'photoshop tutorial — create your you avatar': Hint is not relevant

2 l
to the query, matching only part of the title in the end. The content is more
of a tutorial, just in video format.

53 tia
o ' → 'frozen ii': The hint is not relevant to the query. The hint has no
relevancy to the query consisting of a single apostrophe.
• Explicit content:
o Rate all pornographic/adult themed hints as Unacceptable: Off-
Topic. Exception: If the input intent is specifically for erotic content, or
porn, use above guidelines to find appropriate rating.

99 n
Unacceptable: Extra Language [Removed]
NOTE: This rating option should not be used for this evaluation even though the option is visible
e
in the rating scale.
11 id
Problem: Other
Use this rating only if there is a problem with the task itself in BaseLine. For example, there's no
output to judge.
nf
Co

[Unavailable].png 20.8
KB

Problem: Other rating should not be used if the content is unavailable in Apple TV but it is still
possible to determine relevance between input and output based on the information provided
in BaseLine, and by completing a side search on Google and/or on other streaming platforms
such as Amazon Prime, Netflix, etc.
 Additional Guidelines for Japan
Whatever form of the query is entered, text hints should be in the proper form when it points
to a specific piece of content. The proper form of the content can be found in Apple TV JP
storefront.

2 l
53 tia
99 ne
11 id
nf
Co

Proper form
 Non-Japanese Content/Cast
If the intent is for non-Japanese content/cast and in Apple TV JP, hints using original
name/content title and hints using the same form used to display the content in Apple TV JP are
both considered Perfect hints.

2 l
53 tia
Query: 「ララ」
Intent:「ラ・ラ・ランド」

ラ・ラ・ランド → Perfect (Official name in Apple TV JP)

ララランド → Perfect (Hints without・is okay)
La La Land → Perfect (English, original movie name)
ら・ら・らんど → Acceptable (Movie name in Hiragana - non-proper form)

99 n ラ・ラ・ラント → Unacceptable: Spelling (Misspelled hints are unacceptable)

Query:「新たなる希望」
Intent:「スター・ウォーズ エピソード4 / 新たなる希望」

JP)
e スター・ウォーズ エピソード4 / 新たなる希望 → Perfect (Official name in Apple TV
11 id
Star Wars: Episode IV – A New Hope → Perfect (English, original movie name)
スター・ウォーズ エピソード4 / ア・ニュー・ホープ → Good (English titles can be
written in Katakana)
nf

Japanese Content/Cast
If the intent is for Japanese content/cast and English is used in Apple TV JP, i.e. HERO, AKIRA,
THE LAST MESSAGE 海猿 etc., proper form is English. In this case, Katakana hints should be
demoted.
If Hiragana, Katakana, and/or Kanji is used, only hints using the writing system from the official
Co

name in Apple TV JP are Perfect hints.

One Piece Film Gold

Query:「O」
Intent: 「ONE PIECE FILM GOLD」 → Proper form is English.
 ONE PIECE FILM GOLD → Perfect (Original format: English)
ワンピース フィルムゴールド → Good (Katakana replacing English)
わんぴーす ふぃるむごーるど → Acceptable (Hiragana)

2 l
フィルムゴールド → Acceptable (Incomplete title)

53 tia
Query:「銀魂 THE FINAL」
Intent: 「銀魂 THE FINAL」 → Proper form is Kanji + English
銀魂 THE FINAL → Perfect (Original format - English)
銀魂 ザ・ファイナル → Good (Kanji + Katakana replacing English)
ぎんたま ザ・ファイナル → Acceptable (Kanji is replaced by Hiragana)
ぎんたま THE FINAL → Acceptable (Kanji is replaced by Hiragana)

99 n
Query:「ガッキー」(Nickname for Yui Aragaki)
Intent:「 新垣結衣」→ Proper form is Kanji
e ガッキー → Perfect
新垣結衣 → Perfect (Kanji)
アラガキ ユイ→ Acceptable (Katakana)
11 id
あらがき ゆい→ Acceptable (Hiragana)

Query:「トトロ」
Intent:「 となりのトトロ」→ Proper form is Hiragana + Katakana
nf

となりのトトロ→ Perfect (Original format)

隣のトトロ → Acceptable (Hiragana is replaced by Kanji)
となりのととろ → Acceptable (Katakana is replaced by Kanji)
トナリノトトロ → Acceptable (Hiragana is replaced by Katakana)
Co

Special Cases
If the official content title includes numbers, the format used in original title are Perfect hints.
Hints in another format are Good hints.

Query:「always」
Intent:「 ALWAYS 三丁目の夕日」

ALWAYS 三丁目の夕日 → Perfect (Original title)

ALWAYS 3丁目の夕日 → Good (3 instead of 三 in Kanji)

Query:「秒速」
Intent:「 秒速5センチメートル」
 秒速5センチメートル → Perfect (Original title)
秒速五センチメートル → Good (五 instead of 5)

2 l
53 tia
99 ne
11 id
nf
Co