fix: DH-18798 - token cache growing unbounded

[mattrunyon]

This adds a cache for the token cache. I tested this was actually causing the issue by adding some code to the cell renderer to prefill the cache to 1 million items. It hung around 200k without the max. With max it prefills just fine (cleaning out every 10k) and doesn't hinder performance.

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 46.80%. Comparing base (b1787c8) to head (1bfdd13).
Report is 1 commits behind head on main.

Additional details and impacted files

@@           Coverage Diff           @@
##             main    #2374   +/-   ##
=======================================
  Coverage   46.80%   46.80%           
=======================================
  Files         710      710           
  Lines       39226    39226           
  Branches     9975     9975           
=======================================
  Hits        18358    18358           
  Misses      20814    20814           
  Partials       54       54           

Flag	Coverage Δ
unit	46.80% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

PR Overview

This PR addresses the issue of an unbounded token cache by introducing a maximum limit in the token processing function within the grid model.

• Adds an options parameter with a max limit to the call of GridUtils.findTokensWithProtocolInText.
• Updates the GridModel.ts file accordingly.

Reviewed Changes

File	Description
packages/grid/src/GridModel.ts	Adds an options object with a max limit to control token caching

Copilot reviewed 1 out of 1 changed files in this pull request and generated no comments.

Comments suppressed due to low confidence (1)

packages/grid/src/GridModel.ts:232

• Confirm that adding an options object as a second argument to GridUtils.findTokensWithProtocolInText aligns with its expected function signature. This change is critical to ensure that the caching behavior is properly controlled.

},