summaryrefslogtreecommitdiff
path: root/cli/bench/main.rs
diff options
context:
space:
mode:
authorNathan Whitaker <17734409+nathanwhit@users.noreply.github.com>2024-04-16 12:26:51 -0700
committerGitHub <noreply@github.com>2024-04-16 12:26:51 -0700
commit422cff1f247dc334d5eb9387be924f5937b0c6d9 (patch)
treea6abe5c97fb53163310687f6e0010eb774cdee2c /cli/bench/main.rs
parentc4d0fceec37e3842fad4aeb5afb0dfac4353390d (diff)
chore(lsp): Add benchmark for performance on a large real-world repo (#23395)
This PR adds a benchmark intended to measure how the LSP handles larger repos, as well as its performance on a more realistic workload. The repo being benchmarked is [deco-cx/apps](https://github.com/deco-cx/apps) which has been vendored along with its dependencies. It's included as a git submodule as its fairly large. The LSP requests used in the benchmark are the actual requests sent by VSCode as I opened, modified, and navigated around a file (to simulate an actual user interaction). The main motivation is to have a more realistic benchmark that measures how we do with a large number of files and dependencies. The improvements made from 1.42 to 1.42.3 mostly improved performance with larger repos, so none of our existing benchmarks showed an improvement. Here are the results for the changes made from 1.42 to 1.42.3 (the new benchmark is the last one listed): **1.42.0** ```test Starting Deno benchmark -> Start benchmarking lsp - Simple Startup/Shutdown (10 runs, mean: 379ms) - Big Document/Several Edits (5 runs, mean: 1142ms) - Find/Replace (10 runs, mean: 51ms) - Code Lens (10 runs, mean: 443ms) - deco-cx/apps Multiple Edits + Navigation (5 runs, mean: 25121ms) <- End benchmarking lsp ``` **1.42.3** ```text Starting Deno benchmark -> Start benchmarking lsp - Simple Startup/Shutdown (10 runs, mean: 383ms) - Big Document/Several Edits (5 runs, mean: 1135ms) - Find/Replace (10 runs, mean: 55ms) - Code Lens (10 runs, mean: 440ms) - deco-cx/apps Multiple Edits + Navigation (5 runs, mean: 11675ms) <- End benchmarking lsp ```
Diffstat (limited to 'cli/bench/main.rs')
-rw-r--r--cli/bench/main.rs6
1 files changed, 5 insertions, 1 deletions
diff --git a/cli/bench/main.rs b/cli/bench/main.rs
index d58a6fdb6..9bae6fab6 100644
--- a/cli/bench/main.rs
+++ b/cli/bench/main.rs
@@ -431,7 +431,11 @@ async fn main() -> Result<()> {
println!("Starting Deno benchmark");
let target_dir = test_util::target_dir();
- let deno_exe = test_util::deno_exe_path().to_path_buf();
+ let deno_exe = if let Ok(p) = std::env::var("DENO_BENCH_EXE") {
+ PathBuf::from(p)
+ } else {
+ test_util::deno_exe_path().to_path_buf()
+ };
env::set_current_dir(test_util::root_path())?;
let mut new_data = BenchResult {