Extracting URLs from JavaScript via program analysis

Authors:
Qi Wang;Jingyu Zhou;Yuting Chen;Yizhou Zhang;Jianjun Zhao
Affiliations:
Shanghai Jiao Tong University, China;Shanghai Jiao Tong University, China;Shanghai Jiao Tong University, China;Shanghai Jiao Tong University, China / Cornell University, USA;Shanghai Jiao Tong University, China
Venue:
Proceedings of the 2013 9th Joint Meeting on Foundations of Software Engineering
Year:
2013

Citing 9
Cited 0

Static approximation of dynamically generated Web pages

WWW '05 Proceedings of the 14th international conference on World Wide Web
A taxonomy of JavaScript redirection spam

AIRWeb '07 Proceedings of the 3rd international workshop on Adversarial information retrieval on the web
Exploring Multiple Execution Paths for Malware Analysis

SP '07 Proceedings of the 2007 IEEE Symposium on Security and Privacy
Crawling AJAX by Inferring User Interface State Changes

ICWE '08 Proceedings of the 2008 Eighth International Conference on Web Engineering
AJAX Crawl: Making AJAX Applications Searchable

ICDE '09 Proceedings of the 2009 IEEE International Conference on Data Engineering
Detection and analysis of drive-by-download attacks and malicious JavaScript code

Proceedings of the 19th international conference on World wide web
Path- and index-sensitive string analysis based on monadic second-order logic

Proceedings of the 2011 International Symposium on Software Testing and Analysis
Design and Evaluation of a Real-Time URL Spam Filtering Service

SP '11 Proceedings of the 2011 IEEE Symposium on Security and Privacy
Modeling the HTML DOM and browser API in static analysis of JavaScript web applications

Proceedings of the 19th ACM SIGSOFT symposium and the 13th European conference on Foundations of software engineering

Quantified Score

Hi-index	0.00

Visualization

Abstract

With the extensive use of client-side JavaScript in web applications, web contents are becoming more dynamic than ever before. This poses significant challenges for search engines, because more web URLs are now embedded or hidden inside JavaScript code and most web crawlers are script-agnostic, significantly reducing the coverage of search engines. We present a hybrid approach that combines static analysis with dynamic execution, overcoming the weakness of a purely static or dynamic approach that either lacks accuracy or suffers from huge execution cost. We also propose to integrate program analysis techniques such as statement coverage and program slicing to improve the performance of URL mining.