diff options
Diffstat (limited to 'vanilla/node_modules/js-tokens/README.md')
| -rw-r--r-- | vanilla/node_modules/js-tokens/README.md | 14 |
1 files changed, 14 insertions, 0 deletions
diff --git a/vanilla/node_modules/js-tokens/README.md b/vanilla/node_modules/js-tokens/README.md new file mode 100644 index 0000000..b8cd3df --- /dev/null +++ b/vanilla/node_modules/js-tokens/README.md @@ -0,0 +1,14 @@ +# js-tokens + +The tiny, regex powered, lenient, _almost_ spec-compliant JavaScript tokenizer that never fails. + +```js +import jsTokens from "js-tokens"; + +const jsString = 'JSON.stringify({k:3.14**2}, null /*replacer*/, "\\t")'; + +Array.from(jsTokens(jsString), (token) => token.value).join("|"); +// JSON|.|stringify|(|{|k|:|3.14|**|2|}|,| |null| |/*replacer*/|,| |"\t"|) +``` + +**[➡️ Full readme](https://github.com/lydell/js-tokens/)**
\ No newline at end of file |