js-tokens

Tiny JavaScript tokenizer.

Last updated a year ago by lydell .

MIT · Repository · Bugs · Original npm · Tarball · package.json

$ gnpm install js-tokens

SYNC missed versions from official npm registry.

js-tokens

The tiny, regex powered, lenient, almost spec-compliant JavaScript tokenizer that never fails.

const jsTokens = require("js-tokens");

const jsString = 'JSON.stringify({k:3.14**2}, null /*replacer*/, "\\t")';

Array.from(jsTokens(jsString), (token) => token.value).join("|");
// JSON|.|stringify|(|{|k|:|3.14|**|2|}|,| |null| |/*replacer*/|,| |"\t"|)

➡️ Full readme

Current Tags

8.0.2 ... latest (a year ago)

21 Versions

Maintainers (1)

lydell

Downloads

Today 0

This Week 0

This Month 0

Last Day 0

Last Week 0

Last Month 0

Dependencies (0)

None

Dev Dependencies (0)

None

Dependents (7)