TanTan
2a69b23b47
Dev Build / cleanup (push) Canceled after 0s
Dev Build / typecheck (push) Canceled after 0s
Dev Build / build (linux-arm64, ubuntu-24.04-arm, linux-arm64) (push) Canceled after 0s
Dev Build / build (linux-x64, ubuntu-latest, linux-x64) (push) Canceled after 0s
Dev Build / build (win-x64, windows-latest, win32-x64) (push) Canceled after 0s
Dev Build / dispatch-dev-docker (push) Canceled after 0s
14 lines
435 B
Plaintext
14 lines
435 B
Plaintext
# js-tokens
|
|
|
|
The tiny, regex powered, lenient, _almost_ spec-compliant JavaScript tokenizer that never fails.
|
|
|
|
```js
|
|
import jsTokens from "js-tokens";
|
|
|
|
const jsString = 'JSON.stringify({k:3.14**2}, null /*replacer*/, "\\t")';
|
|
|
|
Array.from(jsTokens(jsString), (token) => token.value).join("|");
|
|
// JSON|.|stringify|(|{|k|:|3.14|**|2|}|,| |null| |/*replacer*/|,| |"\t"|)
|
|
```
|
|
|
|
**[➡️ Full readme](https://github.com/lydell/js-tokens/)** |