Difference between revisions of "The Street View Text Dataset"
From TC11
(Created page with "Datasets -> Datasets List -> Current Page {| style="width: 100%" |- | align="right" | {| |- | '''Created: '''2012-10-06 |- | {{Last updated}} |} |} =Contact Author=…") |
|||
| (2 intermediate revisions by the same user not shown) | |||
| Line 22: | Line 22: | ||
La Jolla, CA 92093-0404 | La Jolla, CA 92093-0404 | ||
Email: k[http://mailhide.recaptcha.net/d?k=01omEyRZid0nVm1TN9t98J1A==&c=cUMGBbQUpaP6Zu0AxhNJ8zylFKIVmLYKdQ3GCxUgtxY= ...]@cs.ucsd.edu | Email: k[http://mailhide.recaptcha.net/d?k=01omEyRZid0nVm1TN9t98J1A==&c=cUMGBbQUpaP6Zu0AxhNJ8zylFKIVmLYKdQ3GCxUgtxY= ...]@cs.ucsd.edu | ||
| − | |||
| − | |||
=Current Version= | =Current Version= | ||
| − | + | 1.0 (also available from the [http://vision.ucsd.edu/~kai/svt/ Author's Web site]) | |
| − | |||
| − | |||
| − | |||
| − | |||
| − | 1.0 (also available from the [http:// | ||
=Keywords= | =Keywords= | ||
| − | OCR, | + | [[Image:StreetViewText_Sample.jpg|400px|thumb|right| Example images from the Street View Text dataset.]] |
| + | OCR, Real Scene, Urban Scene, Scene Text, Word Spotting, Scene Text Recognition, Scene Text Detection, Scene Text Localization | ||
=Description= | =Description= | ||
| − | The | + | The Street View Text (SVT) dataset was harvested from Google Street View. Image text in this data exhibits high variability and often has low resolution. In dealing with outdoor street level imagery, we note two characteristics. (1) Image text often comes from business signage and (2) business names are easily available through geographic business searches. These factors make the SVT set uniquely suited for word spotting in the wild: given a street view image, the goal is to identify words from nearby businesses. More details about the data set can be found in our paper, Word Spotting in the Wild [[#References|[1]]]. For our up-to-date benchmarks on this data, see our paper, End-to-end Scene Text Recognition [[#References|[2]]]. |
| − | + | This dataset only has word-level annotations (no character bounding boxes) and should be used for | |
| + | * cropped lexicon-driven word recognition and | ||
| + | * full image lexicon-driven word detection and recognition. | ||
| + | |||
| + | If you need character training data then you should look into the [http://vision.ucsd.edu/~kai/svt/#related Chars74K] and the [http://www.iapr-tc11.org/mediawiki/index.php/ICDAR_2003_Robust_Reading_Competitions ICDAR2003] and [http://www.iapr-tc11.org/mediawiki/index.php/ICDAR_2005_Robust_Reading_Competitions ICDAR2005] datasets. | ||
=Metadata and Ground Truth Data= | =Metadata and Ground Truth Data= | ||
| − | + | [[Image:StreetViewText_Example.png|400px|thumb|right| '''Task''': locate all the words in an image that appear in its lexicon. While there is other text in the image, only the lexicon words are to be detected. This contrasts from the more general OCR problem. '''Lexicon''': ''HOLIDAY, INN, EXPRESS, HOTEL, NEW, YORK, CITY, FIFTH, AVENUE, MICHAEL, FINA, CINEMA, CAFE, 45TH, STARBUCKS, BINDER, DAVID, DDS, MANHATTAN, DENTIST, BARNES, NOBLE, BOOKSELLERS, AVE, ART, BROWN, INTERNATIONAL, PEN, SHOP, MORTON, THE, STEAKHOUSE, DISHES, BUILD, BEAR, WORKSHOP, HARVARD, CLUB, CORNELL, PACE, UNIVERSITY, LENSCRAFTERS, SETTE, FOSSIL, STORE, 5TH, JEWEL, INDIA, RESTAURANT, KELLARI, TAVERNA, YACHT'']] | |
| + | We used Amazon's Mechanical Turk to harvest and label the images from Google Street View. To build the data set, we created several Human Intelligence Tasks (HITs) to be completed on Mechanical Turk. | ||
| − | + | ==Harvest images== | |
| + | Workers are assigned a unique city and are requested to acquire 20 images that contain text from Google Street view. They were instructed to: (1) perform a Search Nearby:* on their city, (2) examine the businesses in the search results, and (3) look at the associated street view for images containing text from the business name. If words are found, they compose the scene to minimize skew, save a screen shot, and record the business name and address. | ||
| − | + | ==Image annotation== | |
| + | Workers are presented with an image and a list of candidate words to label with bounding boxes. This contrasts with the ICDAR Robust Reading data set in that we only label words associated with businesses. We used Alex Sorokin's Annotation Toolkit to support bounding box image annotation. For each image, we obtained a list of local business names using the Search Nearby:* in Google Maps at the image's address. We stored the top 20 business results for each image, typically resulting in 50 unique words. To summarize, the SVT data set consists of images collected from Google Street View, where each image is annotated with bounding boxes around words from businesses around where the image was taken. | ||
| − | + | The annotations are in XML using tags similar to those from the [http://algoval.essex.ac.uk/icdar/Datasets.html ICDAR 2003 Robust Reading Competition]. | |
| − | |||
---- | ---- | ||
=References= | =References= | ||
| − | # | + | # Kai Wang, Boris Babenko and Serge Belongie, "End-to-end Scene Text Recognition", [http://www.iccv2011.org/ ICCV 2011], Barcelona, Spain [http://www.iapr-tc11.org/dataset/SVT/wang_iccv2011.pdf (PDF)]. Galleries: [http://vision.ucsd.edu/~kai/grocr/icdar/gallery.html ICDAR], [http://vision.ucsd.edu/~kai/grocr/svt/gallery.html SVT]. |
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| + | # Kai Wang and Serge Belongie, "Word Spotting in the Wild", [http://www.ics.forth.gr/eccv2010/intro.php ECCV 2010], Heraklion, Crete, Greece [http://www.iapr-tc11.org/dataset/SVT/wang_eccv2010.pdf (PDF)]. | ||
| + | |||
| + | =Download= | ||
==Version 1.0== | ==Version 1.0== | ||
| − | * [http://www.iapr-tc11.org/dataset/ | + | * [http://www.iapr-tc11.org/dataset/SVT/svt.zip The complete Street View Text dataset along with annotations] (118 MB) |
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
---- | ---- | ||
This page is editable only by [[IAPR-TC11:Reading_Systems#TC11_Officers|TC11 Officers ]]. | This page is editable only by [[IAPR-TC11:Reading_Systems#TC11_Officers|TC11 Officers ]]. | ||
Latest revision as of 11:40, 27 October 2012
Datasets -> Datasets List -> Current Page
|
Contents
Contact Author
Kai Wang EBU3B, Room 4148 Department of Comp. Sci. and Engr. University of California, San Diego 9500 Gilman Drive, Mail Code 0404 La Jolla, CA 92093-0404 Email: k...@cs.ucsd.edu
Current Version
1.0 (also available from the Author's Web site)
Keywords
OCR, Real Scene, Urban Scene, Scene Text, Word Spotting, Scene Text Recognition, Scene Text Detection, Scene Text Localization
Description
The Street View Text (SVT) dataset was harvested from Google Street View. Image text in this data exhibits high variability and often has low resolution. In dealing with outdoor street level imagery, we note two characteristics. (1) Image text often comes from business signage and (2) business names are easily available through geographic business searches. These factors make the SVT set uniquely suited for word spotting in the wild: given a street view image, the goal is to identify words from nearby businesses. More details about the data set can be found in our paper, Word Spotting in the Wild [1]. For our up-to-date benchmarks on this data, see our paper, End-to-end Scene Text Recognition [2].
This dataset only has word-level annotations (no character bounding boxes) and should be used for
- cropped lexicon-driven word recognition and
- full image lexicon-driven word detection and recognition.
If you need character training data then you should look into the Chars74K and the ICDAR2003 and ICDAR2005 datasets.
Metadata and Ground Truth Data
Task: locate all the words in an image that appear in its lexicon. While there is other text in the image, only the lexicon words are to be detected. This contrasts from the more general OCR problem. Lexicon: HOLIDAY, INN, EXPRESS, HOTEL, NEW, YORK, CITY, FIFTH, AVENUE, MICHAEL, FINA, CINEMA, CAFE, 45TH, STARBUCKS, BINDER, DAVID, DDS, MANHATTAN, DENTIST, BARNES, NOBLE, BOOKSELLERS, AVE, ART, BROWN, INTERNATIONAL, PEN, SHOP, MORTON, THE, STEAKHOUSE, DISHES, BUILD, BEAR, WORKSHOP, HARVARD, CLUB, CORNELL, PACE, UNIVERSITY, LENSCRAFTERS, SETTE, FOSSIL, STORE, 5TH, JEWEL, INDIA, RESTAURANT, KELLARI, TAVERNA, YACHT
We used Amazon's Mechanical Turk to harvest and label the images from Google Street View. To build the data set, we created several Human Intelligence Tasks (HITs) to be completed on Mechanical Turk.
Harvest images
Workers are assigned a unique city and are requested to acquire 20 images that contain text from Google Street view. They were instructed to: (1) perform a Search Nearby:* on their city, (2) examine the businesses in the search results, and (3) look at the associated street view for images containing text from the business name. If words are found, they compose the scene to minimize skew, save a screen shot, and record the business name and address.
Image annotation
Workers are presented with an image and a list of candidate words to label with bounding boxes. This contrasts with the ICDAR Robust Reading data set in that we only label words associated with businesses. We used Alex Sorokin's Annotation Toolkit to support bounding box image annotation. For each image, we obtained a list of local business names using the Search Nearby:* in Google Maps at the image's address. We stored the top 20 business results for each image, typically resulting in 50 unique words. To summarize, the SVT data set consists of images collected from Google Street View, where each image is annotated with bounding boxes around words from businesses around where the image was taken.
The annotations are in XML using tags similar to those from the ICDAR 2003 Robust Reading Competition.
References
- Kai Wang, Boris Babenko and Serge Belongie, "End-to-end Scene Text Recognition", ICCV 2011, Barcelona, Spain (PDF). Galleries: ICDAR, SVT.
- Kai Wang and Serge Belongie, "Word Spotting in the Wild", ECCV 2010, Heraklion, Crete, Greece (PDF).
Download
Version 1.0
This page is editable only by TC11 Officers .