Crawl rendered JavaScript templates from a local server.
Project description
Command line tool that crawls a local webserver with a headless browser and outputs static html files. Works well with html5validator to validate HTML5 from dynamic content with Javascript.
Run localcrawl --help:
PhantomJS is required. It is pre-installed on TravisCI. On a Mac run brew install PhantomJS.
Example Command
localcrawl --start _build/html/index.html --out _crawled/ --depth 3
Mustache Example
This can be used to convert templated files to HTML files (e.g. for validation with html5validator).
Input:
<html>
<head>
<title>Mustache Test</title>
</head>
<body>
<div id="output"></div>
<script type="text/javascript" src="https://cdnjs.cloudflare.com/ajax/libs/mustache.js/2.2.1/mustache.min.js"></script>
<script>
var data = {
item: 'Fork',
price: function() { return (1.10 * 1.08).toFixed(2); },
};
var html = Mustache.render('{{item}}: <b>${{price}}</b>', data);
document.getElementById('output').innerHTML = html;
</script>
</body>
</html>
The crawled output includes the output from processing the template (Fork: <b>$1.19</b>):
<html><head>
<title>Mustache Test</title>
</head>
<body>
<div id="output">Fork: <b>$1.19</b></div>
<script type="text/javascript" src="https://cdnjs.cloudflare.com/ajax/libs/mustache.js/2.2.1/mustache.min.js"></script>
<script>
var data = {
item: 'Fork',
price: function() { return (1.10 * 1.08).toFixed(2); },
};
var html = Mustache.render('{{item}}: <b>${{price}}</b>', data);
document.getElementById('output').innerHTML = html;
</script>
</body></html>
Should play nice with:
JavaScript template engines / JS frameworks:
Static site generators:
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
localcrawl-0.2.3.tar.gz
(5.2 kB
view hashes)
Built Distribution
Close
Hashes for localcrawl-0.2.3-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2f7c629bc110bf3f3b0c8773ab87f8c11c5adc85bcb2d2a1000a1aad382f4c7f |
|
MD5 | 27f9aeeb5af2eecf990dc5a243698797 |
|
BLAKE2b-256 | 5a94dab8a257e468a5f91b5bc3ade9cd92d6c5c33c97989a3643f2213ff3b16e |