singularity/singularity-forge
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
singularity-forge/native/crates/engine/Cargo.toml

45 lines
1.1 KiB
TOML
Raw Normal View History

feat: Rust native engine scaffold with grep module * feat: scaffold Rust native engine with grep module (napi-rs) Adds a Rust N-API addon architecture inspired by Oh My Pi's pi-natives. The grep module wraps ripgrep's core crates (grep-regex, grep-searcher, grep-matcher) and exposes `search()` and `grep()` to Node.js via napi-rs. Includes: - Cargo workspace at native/ with engine (cdylib) and grep (lib) crates - Build script (native/scripts/build.js) producing platform-tagged .node files - TypeScript wrapper package (@gsd/native) with types and loader - 6 Rust unit tests + 9 Node.js integration tests (all passing) Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> * fix: audit fixes for rust native engine PR - Fix repository URL to gsd-build/gsd-2 - Remove dead add_custom_ignore_filename("") call - Unify error model: search() now returns Result<> (throws) matching grep() - Remove error field from NapiSearchResult and SearchResult types - Use t.after() in integration tests for reliable temp dir cleanup Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> --------- Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-13 12:21:09 -06:00
[package]
name = "gsd-engine"
version.workspace = true
edition.workspace = true
license.workspace = true
authors.workspace = true
repository.workspace = true
description = "N-API native addon for GSD — exposes high-performance Rust modules to Node.js"
[lib]
crate-type = ["cdylib"]
[dependencies]
feat: add native ast module with ast-grep structural search and rewrite Adds the `gsd-ast` crate providing AST-aware code search (`astGrep`) and rewrite (`astEdit`) via ast-grep with tree-sitter grammars for 38+ languages. Replaces Oh My Pi's fs_cache/task dependencies with the `ignore` crate for .gitignore-respecting file walking. Includes TypeScript type declarations and wrappers in packages/native. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-13 13:01:41 -06:00
gsd-ast = { path = "../ast" }
feat: Rust native engine scaffold with grep module * feat: scaffold Rust native engine with grep module (napi-rs) Adds a Rust N-API addon architecture inspired by Oh My Pi's pi-natives. The grep module wraps ripgrep's core crates (grep-regex, grep-searcher, grep-matcher) and exposes `search()` and `grep()` to Node.js via napi-rs. Includes: - Cargo workspace at native/ with engine (cdylib) and grep (lib) crates - Build script (native/scripts/build.js) producing platform-tagged .node files - TypeScript wrapper package (@gsd/native) with types and loader - 6 Rust unit tests + 9 Node.js integration tests (all passing) Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> * fix: audit fixes for rust native engine PR - Fix repository URL to gsd-build/gsd-2 - Remove dead add_custom_ignore_filename("") call - Unify error model: search() now returns Result<> (throws) matching grep() - Remove error field from NapiSearchResult and SearchResult types - Use t.after() in integration tests for reliable temp dir cleanup Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> --------- Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-13 12:21:09 -06:00
gsd-grep = { path = "../grep" }
feat: add native clipboard module with arboard backend (#228) Cross-platform clipboard access (text read/write, image read) via the arboard Rust crate. No external tools (pbcopy, xclip, etc.) required. Ported from Oh My Pi's clipboard module with adaptations for GSD's architecture (direct AsyncTask instead of task::blocking wrapper). Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-13 12:48:27 -06:00
arboard = "3"
feat: add native glob and fs_cache modules with gitignore-aware discovery (#226) Port glob, glob_util, and fs_cache modules from Oh My Pi's pi-natives crate, adapted for napi-rs v2. Provides gitignore-respecting filesystem discovery with a TTL-based scan cache, mtime sorting, file-type filtering, and node_modules exclusion. Includes a task module for async N-API work scheduling with cooperative cancellation (timeout-based), TypeScript type declarations and wrapper, and 12 integration tests covering pattern matching, recursion, gitignore, maxResults, sortByMtime, fileType filtering, and cache invalidation. Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-13 12:45:56 -06:00
dashmap = "6"
globset = "0.4"
feat: add html-to-markdown native module Port HTML-to-Markdown conversion from Oh My Pi's html module using html-to-markdown-rs. Exposes `htmlToMarkdown()` via N-API with options for content cleaning (strip nav/forms/headers/footers) and image skipping. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-13 12:40:22 -06:00
html-to-markdown-rs = { version = "2", default-features = false }
feat: add native glob and fs_cache modules with gitignore-aware discovery (#226) Port glob, glob_util, and fs_cache modules from Oh My Pi's pi-natives crate, adapted for napi-rs v2. Provides gitignore-respecting filesystem discovery with a TTL-based scan cache, mtime sorting, file-type filtering, and node_modules exclusion. Includes a task module for async N-API work scheduling with cooperative cancellation (timeout-based), TypeScript type declarations and wrapper, and 12 integration tests covering pattern matching, recursion, gitignore, maxResults, sortByMtime, fileType filtering, and cache invalidation. Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-13 12:45:56 -06:00
ignore = "0.4"
feat: native Rust output truncation module (#268) * feat: add native Rust output truncation module Line-boundary-aware truncation for tool outputs (bash, grep, file reads), replacing JS byte-counting with native Rust via napi-rs. Supports head, tail, and both modes. Counts by UTF-8 bytes, respects line boundaries, uses memchr for fast newline scanning. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * fix: remove unsafe blocks and fix truncation message byte counts Replace unsafe from_utf8_unchecked with safe from_utf8().expect() — the invariant (splitting at newline boundaries) is sound but the perf difference is negligible, so no reason to use unsafe. Fix truncateOutput messages that reported the byte budget as "bytes truncated" instead of the actual number of bytes removed. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> --------- Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-13 16:48:49 -06:00
memchr = "2"
feat: add native image module — decode, encode, and resize via Rust image crate Port image processing from Oh My Pi's pi-natives crate, adapted for napi-rs v2. Exposes NativeImage class with async parse/encode/resize methods backed by the Rust `image` crate (PNG, JPEG, WebP, GIF support). Includes: - task.rs: lightweight async task scheduling for libuv thread pool - image.rs: NativeImage class with SamplingFilter enum - TypeScript types and wrapper (parseImage, ImageFormat, SamplingFilter) - 8 passing tests covering decode, encode, resize, round-trip, error cases Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-13 12:51:49 -06:00
image = { version = "0.25", default-features = false, features = [
"png",
"jpeg",
"gif",
"webp",
] }
feat: Rust native engine scaffold with grep module * feat: scaffold Rust native engine with grep module (napi-rs) Adds a Rust N-API addon architecture inspired by Oh My Pi's pi-natives. The grep module wraps ripgrep's core crates (grep-regex, grep-searcher, grep-matcher) and exposes `search()` and `grep()` to Node.js via napi-rs. Includes: - Cargo workspace at native/ with engine (cdylib) and grep (lib) crates - Build script (native/scripts/build.js) producing platform-tagged .node files - TypeScript wrapper package (@gsd/native) with types and loader - 6 Rust unit tests + 9 Node.js integration tests (all passing) Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> * fix: audit fixes for rust native engine PR - Fix repository URL to gsd-build/gsd-2 - Remove dead add_custom_ignore_filename("") call - Unify error model: search() now returns Result<> (throws) matching grep() - Remove error field from NapiSearchResult and SearchResult types - Use t.after() in integration tests for reliable temp dir cleanup Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> --------- Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-13 12:21:09 -06:00
napi = { version = "2", features = ["napi8"] }
napi-derive = "2"
feat: add native Rust TTSR regex engine via RegexSet TTSR's checkDelta() runs O(rules x conditions) regex evaluations per streaming token — the hottest path in GSD. This adds a Rust native module that compiles all condition patterns into a single RegexSet, testing them in one DFA pass instead of sequential JS RegExp iteration. The TtsrManager transparently uses the native engine when available and falls back to the existing JS regex loop when it is not. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-13 13:57:12 -06:00
regex = "1"
feat: native Rust streaming JSON parser (#266) * feat: add native Rust streaming JSON parser for LLM tool call argument parsing Replaces the JS partial-json library with a Rust implementation exposed via napi-rs. The parser handles incomplete JSON from streaming deltas by closing unclosed strings, objects, arrays, removing trailing commas, and completing truncated literals. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * fix: handle truncated numbers and remove dead partial-json dependency Adds truncated number recovery (e.g. `{"key": 12`, `{"key": 3.`, `{"key": 1e`) to the Rust streaming JSON parser, and removes the now-unused `partial-json` npm dependency from pi-ai. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> --------- Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-13 16:21:58 -06:00
serde_json = "1"
feat: add native Rust diff engine for edit tool Move the edit tool's hot-path diffing operations from JS to native Rust: - `normalizeForFuzzyMatch`: single-pass Unicode normalization (smart quotes, dashes, special spaces, trailing whitespace) - `fuzzyFindText`: exact-then-fuzzy substring search with UTF-16 index conversion for JS compatibility - `generateDiff`: unified diff generation using the `similar` crate (Myers' algorithm with optimizations) The Rust module at `native/crates/engine/src/diff.rs` exposes three napi functions. The TypeScript wrapper at `packages/native/src/diff/` follows the existing module pattern. `edit-diff.ts` now delegates to native implementations while keeping line-ending handling and file I/O in JS. 18 tests covering normalization, fuzzy matching (including UTF-16 index correctness with emoji/surrogate pairs), and diff generation. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-13 14:00:39 -06:00
similar = "2"
feat: add ANSI-aware text measurement and slicing native module Port Oh My Pi's optimized text utilities to GSD's native engine: - wrapTextWithAnsi: word-wrap preserving ANSI codes across breaks - truncateToWidth: truncate with ellipsis options - sliceWithWidth: column-range extraction - extractSegments: split around overlay regions - sanitizeText: strip ANSI, remove control chars, normalize CR - visibleWidth: display width excluding ANSI sequences Single-pass ANSI scanning, ASCII fast-path, grapheme-aware Unicode width measurement, and zero-copy input via UTF-16 JsString interop. Includes 19 Rust unit tests and 33 Node.js integration tests. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-13 12:42:42 -06:00
smallvec = "1"
feat: add syntect-based syntax highlighting module to native engine (#227) Port the highlight module from Oh My Pi's pi-natives crate. Provides ANSI-colored syntax highlighting with scope-based semantic token matching across 11 categories (comment, keyword, function, variable, string, number, type, operator, punctuation, inserted, deleted). Exposed N-API functions: - highlightCode(code, lang, colors) -> ANSI-highlighted string - supportsLanguage(lang) -> boolean - getSupportedLanguages() -> string[] Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-13 12:47:02 -06:00
syntect = { version = "5", default-features = false, features = ["default-syntaxes", "default-themes", "regex-fancy"] }
feat: add ANSI-aware text measurement and slicing native module Port Oh My Pi's optimized text utilities to GSD's native engine: - wrapTextWithAnsi: word-wrap preserving ANSI codes across breaks - truncateToWidth: truncate with ellipsis options - sliceWithWidth: column-range extraction - extractSegments: split around overlay regions - sanitizeText: strip ANSI, remove control chars, normalize CR - visibleWidth: display width excluding ANSI sequences Single-pass ANSI scanning, ASCII fast-path, grapheme-aware Unicode width measurement, and zero-copy input via UTF-16 JsString interop. Includes 19 Rust unit tests and 33 Node.js integration tests. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-13 12:42:42 -06:00
unicode-segmentation = "1"
unicode-width = "0.2"
feat: native Rust xxHash32 for hashline (#272) * feat: replace pure-JS xxHash32 with native Rust implementation via napi The hashline edit tool calls xxHash32 on every line of every file read/edit. Moving this to a native Rust implementation (xxhash-rust crate) eliminates JS overhead for this hot path. Hash output is identical -- verified by tests comparing native vs JS reference across 11 input vectors including empty strings, short/long inputs, unicode, and seeded variants. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * fix: use typed native interface and remove version-drag comment in xxhash wrapper Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> --------- Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-13 16:46:08 -06:00
xxhash-rust = { version = "0.8", features = ["xxh32"] }
feat(native): add libgit2-backed git read operations for dispatch hotpath (#388)
2026-03-14 13:07:02 -06:00
git2 = { version = "0.20", default-features = false, features = ["vendored-libgit2"] }
feat: Rust native engine scaffold with grep module * feat: scaffold Rust native engine with grep module (napi-rs) Adds a Rust N-API addon architecture inspired by Oh My Pi's pi-natives. The grep module wraps ripgrep's core crates (grep-regex, grep-searcher, grep-matcher) and exposes `search()` and `grep()` to Node.js via napi-rs. Includes: - Cargo workspace at native/ with engine (cdylib) and grep (lib) crates - Build script (native/scripts/build.js) producing platform-tagged .node files - TypeScript wrapper package (@gsd/native) with types and loader - 6 Rust unit tests + 9 Node.js integration tests (all passing) Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> * fix: audit fixes for rust native engine PR - Fix repository URL to gsd-build/gsd-2 - Remove dead add_custom_ignore_filename("") call - Unify error model: search() now returns Result<> (throws) matching grep() - Remove error field from NapiSearchResult and SearchResult types - Use t.after() in integration tests for reliable temp dir cleanup Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> --------- Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-13 12:21:09 -06:00
[build-dependencies]
napi-build = "2"
feat: add cross-platform process tree kill module (ps) (#225) Port Oh My Pi's ps module providing efficient process tree enumeration and termination using platform-native APIs (libproc on macOS, /proc on Linux, Toolhelp32 on Windows). Exposes four napi functions: killTree, listDescendants, processGroupId, and killProcessGroup. Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-13 12:43:50 -06:00
[target.'cfg(unix)'.dependencies]
libc = "0.2"
Reference in a new issue Copy permalink