Large-Scale Concept Ontology for Multimedia

Authors:
Milind Naphade;John R. Smith;Jelena Tesic;Shih-Fu Chang;Winston Hsu;Lyndon Kennedy;Alexander Hauptmann;Jon Curtis
Affiliations:
IBM T.J. Watson Research Center;IBM T.J. Watson Research Center;IBM T.J. Watson Research Center;Columbia University;Columbia University;Columbia University;Carnegie Mellon University;Cyc Corp.
Venue:
IEEE MultiMedia
Year:
2006

Citing 0
Cited 174

The challenge problem for automated detection of 101 semantic concepts in multimedia

MULTIMEDIA '06 Proceedings of the 14th annual ACM international conference on Multimedia
Techniques used and open challenges to the analysis, indexing and retrieval of digital video

Information Systems
Model-shared subspace boosting for multi-label classification

Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining
IBM multimodal interactive video threading

Proceedings of the 6th ACM international conference on Image and video retrieval
An empirical study of inter-concept similarities in multimedia ontologies

Proceedings of the 6th ACM international conference on Image and video retrieval
Merging storyboard strategies and automatic retrieval for improving interactive video search

Proceedings of the 6th ACM international conference on Image and video retrieval
Cluster-based data modeling for semantic video search

Proceedings of the 6th ACM international conference on Image and video retrieval
Video search in concept subspace: a text-like paradigm

Proceedings of the 6th ACM international conference on Image and video retrieval
How many high-level concepts will fill the semantic gap in news video retrieval?

Proceedings of the 6th ACM international conference on Image and video retrieval
Evaluation of active learning strategies for video indexing

Image Communication
An efficient manual image annotation approach based on tagging and browsing

Workshop on multimedia information retrieval on The many faces of multimedia semantics
Dynamic pictorial ontologies for video digital libraries annotation

Workshop on multimedia information retrieval on The many faces of multimedia semantics
Video diver: generic video indexing with diverse features

Proceedings of the international workshop on Workshop on multimedia information retrieval
Exploiting redundancy in cross-channel video retrieval

Proceedings of the international workshop on Workshop on multimedia information retrieval
Building a comprehensive ontology to refine video concept detection

Proceedings of the international workshop on Workshop on multimedia information retrieval
Kodak's consumer video benchmark data set: concept definition and annotation

Proceedings of the international workshop on Workshop on multimedia information retrieval
Novelty detection for cross-lingual news stories with visual duplicates and speech transcripts

Proceedings of the 15th international conference on Multimedia
The importance of query-concept-mapping for automatic video retrieval

Proceedings of the 15th international conference on Multimedia
Establishing the utility of non-text search for news video retrieval with real world users

Proceedings of the 15th international conference on Multimedia
Query on demand video browsing

Proceedings of the 15th international conference on Multimedia
Ontology-enriched semantic space for video search

Proceedings of the 15th international conference on Multimedia
Semantic concept-based query expansion and re-ranking for multimedia retrieval

Proceedings of the 15th international conference on Multimedia
Image and video indexing using networks of operators

Journal on Image and Video Processing
Image and video indexing using networks of operators

Journal on Image and Video Processing
Collaborative knowledge semantic graph image search

Proceedings of the 17th international conference on World Wide Web
Automatic image annotation via local multi-label classification

CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval
Learning structured concept-segments for interactive video retrieval

CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval
A comparison of color features for visual concept classification

CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval
Accumulated motion energy fields estimation and representation for semantic event detection

CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval
Performance evaluation of relevance feedback methods

CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval
Supporting video library exploratory search: when storyboards are not enough

CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval
Multi-query interactive image and video retrieval -: theory and practice

CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval
Balancing thread based navigation for targeted video search

CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval
Correlative multilabel video annotation with temporal kernels

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Fusing semantics, observability, reliability and diversity of concept detectors for video search

MM '08 Proceedings of the 16th ACM international conference on Multimedia
Exploring multimedia in a keyword space

MM '08 Proceedings of the 16th ACM international conference on Multimedia
Online multi-label active annotation: towards large-scale content-based video search

MM '08 Proceedings of the 16th ACM international conference on Multimedia
ContextSeer: context search and recommendation at query time for shared consumer photos

MM '08 Proceedings of the 16th ACM international conference on Multimedia
SIFT-Bag kernel for video event analysis

MM '08 Proceedings of the 16th ACM international conference on Multimedia
Configuring topologies of distributed semantic concept classifiers for continuous multimedia stream processing

MM '08 Proceedings of the 16th ACM international conference on Multimedia
Search trails using user feedback to improve video search

MM '08 Proceedings of the 16th ACM international conference on Multimedia
Keyword-based concept search on consumer photos by web-based kernel function

MM '08 Proceedings of the 16th ACM international conference on Multimedia
Multimedia information retrieval: watershed events

MIR '08 Proceedings of the 1st ACM international conference on Multimedia information retrieval
A novel approach to enable semantic and visual image summarization for exploratory image search

MIR '08 Proceedings of the 1st ACM international conference on Multimedia information retrieval
Assessing concept selection for video retrieval

MIR '08 Proceedings of the 1st ACM international conference on Multimedia information retrieval
Learning ontology rules for semantic video annotation

MS '08 Proceedings of the 2nd ACM workshop on Multimedia semantics
Angle spectrum for estimation of trajectory deviation using combined tracking and neural network labeling

AREA '08 Proceedings of the 1st ACM workshop on Analysis and retrieval of events/actions and workflows in video streams
Temporal video analysis

AREA '08 Proceedings of the 1st ACM workshop on Analysis and retrieval of events/actions and workflows in video streams
Enriching a Thesaurus to Improve Retrieval of Audiovisual Documents

SAMT '08 Proceedings of the 3rd International Conference on Semantic and Digital Media Technologies: Semantic Multimedia
Retrieving video features for language acquisition

Expert Systems with Applications: An International Journal
Query representation by structured concept threads with application to interactive video retrieval

Journal of Visual Communication and Image Representation
Query by shots: retrieving meaningful events using multiple queries and rough set theory

Proceedings of the 9th International Workshop on Multimedia Data Mining: held in conjunction with the ACM SIGKDD 2008
An index and retrieval framework integrating perceptive features and semantics for multimedia databases

Multimedia Tools and Applications
ViGOR: a grouping oriented interface for search and retrieval in video libraries

Proceedings of the 9th ACM/IEEE-CS joint conference on Digital libraries
Concept-Based Video Retrieval

Foundations and Trends in Information Retrieval
Mobile Web 2.0-Oriented Five Senses Multimedia Technology with LBS-Based Intelligent Agent

UIC '09 Proceedings of the 6th International Conference on Ubiquitous Intelligence and Computing
Improving Automatic Video Retrieval with Semantic Concept Detection

SCIA '09 Proceedings of the 16th Scandinavian Conference on Image Analysis
Video semantic analysis based on structure-sensitive anisotropic manifold ranking

Signal Processing
Query-based video event definition using rough set theory

EiMM '09 Proceedings of the 1st ACM international workshop on Events in multimedia
Image categorization combining neighborhood methods and boosting

LS-MMRM '09 Proceedings of the First ACM workshop on Large-scale multimedia retrieval and mining
A latent semantic retrieval and clustering system for personal photos with sparse speech annotation

SSCS '09 Proceedings of the third workshop on Searching spontaneous conversational speech
Large scale incremental web video categorization

WSMC '09 Proceedings of the 1st workshop on Web-scale multimedia corpus
MovieBase: a movie database for event detection and behavioral analysis

WSMC '09 Proceedings of the 1st workshop on Web-scale multimedia corpus
Semantic context transfer across heterogeneous sources for domain adaptive video search

MM '09 Proceedings of the 17th ACM international conference on Multimedia
Concept detectors: how good is good enough?

MM '09 Proceedings of the 17th ACM international conference on Multimedia
Identifying news videos' ideological perspectives using emphatic patterns of visual concepts

MM '09 Proceedings of the 17th ACM international conference on Multimedia
Unified video annotation via multigraph learning

IEEE Transactions on Circuits and Systems for Video Technology
JustClick: personalized image recommendation via exploratory search from large-scale Flickr images

IEEE Transactions on Circuits and Systems for Video Technology
The role of expertise in aiding video search

Proceedings of the ACM International Conference on Image and Video Retrieval
A visual analysis of the relationship between word concepts and geographical locations

Proceedings of the ACM International Conference on Image and Video Retrieval
Exploring inter-concept relationship with context space for semantic video indexing

Proceedings of the ACM International Conference on Image and Video Retrieval
Integrating visual and semantic contexts for topic network generation and word sense disambiguation

Proceedings of the ACM International Conference on Image and Video Retrieval
Towards surveillance video search by natural language query

Proceedings of the ACM International Conference on Image and Video Retrieval
Reusing annotation labor for concept selection

Proceedings of the ACM International Conference on Image and Video Retrieval
NUS-WIDE: a real-world web image database from National University of Singapore

Proceedings of the ACM International Conference on Image and Video Retrieval
Grounding spatial prepositions for video search

Proceedings of the 2009 international conference on Multimodal interfaces
RoleNet: movie analysis from the perspective of social networks

IEEE Transactions on Multimedia - Special issue on integration of context and content
Correlative linear neighborhood propagation for video annotation

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Knowledge-Based Concept Score Fusion for Multimedia Retrieval

AMT '09 Proceedings of the 5th International Conference on Active Media Technology
Enrichment and Ranking of the YouTube Tag Space and Integration with the Linked Data Cloud

ISWC '09 Proceedings of the 8th International Semantic Web Conference
A lexica family with small semantic GAP

ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
Resource-adaptive multimedia analysis on stream mining systems

ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
Active tagging for image indexing

ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
Statistical motion information extraction and representation for semantic video analysis

IEEE Transactions on Circuits and Systems for Video Technology
Online reranking via ordinal informative concepts for context fusion in concept detection and video search

IEEE Transactions on Circuits and Systems for Video Technology
Exploiting external knowledge to improve video retrieval

Proceedings of the international conference on Multimedia information retrieval
Learning automatic concept detectors from online video

Computer Vision and Image Understanding
Semantic annotation of soccer videos by visual instance clustering and spatial/temporal reasoning in ontologies

Multimedia Tools and Applications
Multimedia ontology based computational framework for video annotation and retrieval

MCAM'07 Proceedings of the 2007 international conference on Multimedia content analysis and mining
Ontology-driven semantic video analysis using visual information objects

SAMT'07 Proceedings of the semantic and digital media technologies 2nd international conference on Semantic Multimedia
MILC2: a multi-layer multi-instance learning approach to video concept detection

MMM'08 Proceedings of the 14th international conference on Advances in multimedia modeling
New approach for hierarchical classifier training and multi-level image annotation

MMM'08 Proceedings of the 14th international conference on Advances in multimedia modeling
A system that learns to tag videos by watching youtube

ICVS'08 Proceedings of the 6th international conference on Computer vision systems
Semantic-aware delivery of multimedia

ISCIT'09 Proceedings of the 9th international conference on Communications and information technologies
Video corpus annotation using active learning

ECIR'08 Proceedings of the IR research, 30th European conference on Advances in information retrieval
Example-based event retrieval in video archive using rough set theory and video ontology

Proceedings of the Tenth International Workshop on Multimedia Data Mining
The accuracy and value of machine-generated image tags: design and user evaluation of an end-to-end image tagging system

Proceedings of the ACM International Conference on Image and Video Retrieval
Genre-specific semantic video indexing

Proceedings of the ACM International Conference on Image and Video Retrieval
Semantic annotation of personal video content using an image folksonomy

ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Thesaurus enrichment for query expansion in audiovisual archives

Multimedia Tools and Applications
Coupled multi-object tracking and labeling for vehicle trajectory estimation and matching

Multimedia Tools and Applications
Constructing distributed hippocratic video databases for privacy-preserving online patient training and counseling

IEEE Transactions on Information Technology in Biomedicine
An asynchronous collaborative search system for online video search

Information Processing and Management: an International Journal
Exploiting noisy visual concept detection to improve spoken content based video retrieval

Proceedings of the international conference on Multimedia
Bilingual query translation and expansion for supporting more effective cross-language image retrieval

Proceedings of the international conference on Multimedia
Semantic video indexing by fusing explicit and implicit context spaces

Proceedings of the international conference on Multimedia
Training strategy of semantic concept detectors using support vector machine in naked image classification

PCM'10 Proceedings of the 11th Pacific Rim conference on Advances in multimedia information processing: Part I
Efficient object category recognition using classemes

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part I
Grounding spatial language for video search

International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction
Travelmedia: An intelligent management system for media captured in travel

Journal of Visual Communication and Image Representation
Multi-modal interview concept detection for rushes exploitation

Large Scale Semantic Access to Content (Text, Image, Video, and Sound)
Event detection and recognition for semantic annotation of video

Multimedia Tools and Applications
Efficient large-scale image data set exploration: visual concept network and image summarization

MMM'11 Proceedings of the 17th international conference on Advances in multimedia modeling - Volume Part II
Development and evaluation of a multifaceted magazine image categorization model

Journal of the American Society for Information Science and Technology
Contextual Video Recommendation by Multimodal Relevance and User Feedback

ACM Transactions on Information Systems (TOIS)
Social negative bootstrapping for visual categorization

Proceedings of the 1st ACM International Conference on Multimedia Retrieval
Aggregating semantic concepts for event representation in lifelogging

Proceedings of the International Workshop on Semantic Web Information Management
Extractable mobile photo tags

Proceedings of the 1st international workshop on Mobile location-based service
Combining visual and textual modalities for multimedia ontology matching

SAMT'10 Proceedings of the 5th international conference on Semantic and digital media technologies
Effectiveness of video ontology in query by example approach

AMT'11 Proceedings of the 7th international conference on Active media technology
Tagging image by exploring weighted correlation between visual features and tags

WAIM'11 Proceedings of the 12th international conference on Web-age information management
Methods for automatic and assisted image annotation

Multimedia Tools and Applications
Automatic tag generation and ranking for sensor-rich outdoor videos

MM '11 Proceedings of the 19th ACM international conference on Multimedia
Coached active learning for interactive video search

MM '11 Proceedings of the 19th ACM international conference on Multimedia
News story clustering from both what and how aspects: using bag of word model and affinity propagation

AIEMPro '11 Proceedings of the 2011 ACM international workshop on Automated media analysis and production for novel TV services
Collaborative video reindexing via matrix factorization

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Generating visual concept network from large-scale weakly-tagged images

MMM'10 Proceedings of the 16th international conference on Advances in Multimedia Modeling
Query-Based video event definition using rough set theory and high-dimensional representation

MMM'10 Proceedings of the 16th international conference on Advances in Multimedia Modeling
A social network for video annotation and discovery based on semantic profiling

Proceedings of the 21st international conference companion on World Wide Web
Building semantic hierarchies faithful to image semantics

MMM'12 Proceedings of the 18th international conference on Advances in Multimedia Modeling
Active cleaning for video corpus annotation

MMM'12 Proceedings of the 18th international conference on Advances in Multimedia Modeling
Discovery of Web user communities and their role in personalization

User Modeling and User-Adapted Interaction
The correlation between semantic visual similarity and ontology-based concept similarity in effective web image search

APWeb'12 Proceedings of the 14th international conference on Web Technologies and Applications
Classifier-specific intermediate representation for multimedia tasks

Proceedings of the 2nd ACM International Conference on Multimedia Retrieval
A comprehensive representation scheme for video semantic ontology and its applications in semantic concept detection

Neurocomputing
Learning by expansion: Exploiting social media for image classification with few training examples

Neurocomputing
Simulating the future of concept-based video retrieval under improved detector performance

Multimedia Tools and Applications
In-video product annotation with web information mining

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Speech technology plays a key role in video semantic indexing

Proceedings of the 2012 ACM international workshop on Audio and multimedia methods for large-scale video analysis
Find you wherever you are: geographic location and environment context-based pedestrian detection

Proceedings of the ACM multimedia 2012 workshop on Geotagging and its applications in multimedia
Use of adaptive still image descriptors for annotation of video frames

ICIAR'07 Proceedings of the 4th international conference on Image Analysis and Recognition
Predicting domain adaptivity: redo or recycle?

Proceedings of the 20th ACM international conference on Multimedia
Dynamic vocabularies for web-based concept detection by trend discovery

Proceedings of the 20th ACM international conference on Multimedia
Intent and its discontents: the user at the wheel of the online video search engine

Proceedings of the 20th ACM international conference on Multimedia
Annotating images with suggestions: user study of a tagging system

ACIVS'12 Proceedings of the 14th international conference on Advanced Concepts for Intelligent Vision Systems
Attributes for classifier feedback

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part III
Unsupervised classemes

ECCV'12 Proceedings of the 12th international conference on Computer Vision - Volume Part III
Towards large scale cross-media retrieval via modeling heterogeneous information and exploring an efficient indexing scheme

CVM'12 Proceedings of the First international conference on Computational Visual Media
Multimedia ontology matching by using visual and textual modalities

Multimedia Tools and Applications
Social tag enrichment via automatic abstract tag refinement

PCM'12 Proceedings of the 13th Pacific-Rim conference on Advances in Multimedia Information Processing
E-Commerce video annotation using goodrelations-based LODs with faceted search in smart TV environment

ICCCI'12 Proceedings of the 4th international conference on Computational Collective Intelligence: technologies and applications - Volume Part II
Improving image tags by exploiting web search results

Multimedia Tools and Applications
Constructing and Utilizing Video Ontology for Accurate and Fast Retrieval

International Journal of Multimedia Data Engineering & Management
Integrating Interactive TV Services and the Web through Semantics

International Journal on Semantic Web & Information Systems
Using visual lifelogs to automatically characterize everyday activities

Information Sciences: an International Journal
A semi-automatic text-based semantic video annotation system for Turkish facilitating multilingual retrieval

Expert Systems with Applications: An International Journal
Multi-label image annotation based on multi-model

Proceedings of the 7th International Conference on Ubiquitous Information Management and Communication
Recommendations for video event recognition using concept vocabularies

Proceedings of the 3rd ACM conference on International conference on multimedia retrieval
Large-scale visual concept detection with explicit kernel maps and power mean SVM

Proceedings of the 3rd ACM conference on International conference on multimedia retrieval
Searching informative concept banks for video event detection

Proceedings of the 3rd ACM conference on International conference on multimedia retrieval
Temporal-Spatial refinements for video concept fusion

ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part III
Near-lossless semantic video summarization and its applications to video analysis

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Riding the multimedia big data wave

Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval
Attribute-augmented semantic hierarchy: towards bridging semantic gap and intention gap in image retrieval

Proceedings of the 21st ACM international conference on Multimedia
Picture tags and world knowledge: learning tag relations from visual semantic sources

Proceedings of the 21st ACM international conference on Multimedia
Massive-scale multimedia semantic modeling

Proceedings of the 21st ACM international conference on Multimedia
Large-scale visual sentiment ontology and detectors using adjective noun pairs

Proceedings of the 21st ACM international conference on Multimedia
Content-based annotation and classification framework: a general multi-purpose approach

Proceedings of the 17th International Database Engineering & Applications Symposium
Multimedia search reranking: A literature survey

ACM Computing Surveys (CSUR)
Learning group-based dictionaries for discriminative image representation

Pattern Recognition
The uncertain representation ranking framework for concept-based video retrieval

Information Retrieval
Semantic context based refinement for news video annotation

Multimedia Tools and Applications
Support vector description of clusters for content-based image annotation

Pattern Recognition
Automatic Abstract Tag Detection for Social Image Tag Refinement and Enrichment

Journal of Signal Processing Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

As increasingly powerful techniques emerge for machine tagging multimedia content, it becomes ever moreimportant to standardize the underlying vocabularies. Doing so provides interoperability and lets themultimedia community focus ongoing research on a well-defined set of semantics. This column describes arecent collaborative effort of multimedia researchers, library scientists, and end users to develop a largestandardized taxonomy for describing broadcast news video. The Large-Scale Concept Ontology for Multimedia(LSCOM) is the first of its kind designed to simultaneously optimize utility to facilitate end-user access,cover a large semantic space, make automated extraction feasible, and increase observability in diversebroadcast news video data sets.