Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Address comment #487

Merged
merged 4 commits into from
Mar 6, 2024
Merged

Conversation

GuanLuo
Copy link
Contributor

@GuanLuo GuanLuo commented Mar 5, 2024

No description provided.

@tgerdesnv tgerdesnv merged commit fd6f2af into tgerdes-endpoint-scaffolding Mar 6, 2024
3 checks passed
@tgerdesnv tgerdesnv deleted the gluo-openai_comments branch March 6, 2024 21:33
tgerdesnv added a commit that referenced this pull request Mar 6, 2024
* Address comment

* Update src/c++/perf_analyzer/client_backend/openai/openai_client.cc

* Update src/c++/perf_analyzer/client_backend/openai/http_client.cc

* formatting

---------

Co-authored-by: Timothy Gerdes <50968584+tgerdesnv@users.noreply.github.com>
Co-authored-by: tgerdes <tgerdes@nvidia.com>
tgerdesnv added a commit that referenced this pull request Mar 6, 2024
* Add openai service-kind and add endpoint to CLI

* Add openai to model parser

* OpenAI client backend + cmake

* Create OpenAI backend

* New JSON datatype for PA. Show json data available at http_client level

* Add an output to OpenAI models

* Add OpenAI client (#482)

* Add OpenAI client

* Address comment

* Pass endpoint to openai client

* Resolve fixmes

* update copyright years

* more cleanup

* Update src/c++/perf_analyzer/command_line_parser.cc

Co-authored-by: dyastremsky <58150256+dyastremsky@users.noreply.github.com>

* remove 'file' from top of files

* clean up help message and add endpoint to help

* Fix client stats

* remove unused fn

* Assert on json input format

* Use a single SEND_END point

* Add sync assert. Add OPENAI to helper fn

* remove unused typedef

* Add batch size assert

* Address comment (#487)

* Address comment

* Update src/c++/perf_analyzer/client_backend/openai/openai_client.cc

* Update src/c++/perf_analyzer/client_backend/openai/http_client.cc

* formatting

---------

Co-authored-by: Timothy Gerdes <50968584+tgerdesnv@users.noreply.github.com>
Co-authored-by: tgerdes <tgerdes@nvidia.com>

* Make copy of exported data so it isn't corrupted (#488)

---------

Co-authored-by: oandreeva-nv <oandreeva@nvidia.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: dyastremsky <58150256+dyastremsky@users.noreply.github.com>
debermudez pushed a commit that referenced this pull request Mar 12, 2024
* Add openai service-kind and add endpoint to CLI

* Add openai to model parser

* OpenAI client backend + cmake

* Create OpenAI backend

* New JSON datatype for PA. Show json data available at http_client level

* Add an output to OpenAI models

* Add OpenAI client (#482)

* Add OpenAI client

* Address comment

* Pass endpoint to openai client

* Resolve fixmes

* update copyright years

* more cleanup

* Update src/c++/perf_analyzer/command_line_parser.cc

Co-authored-by: dyastremsky <58150256+dyastremsky@users.noreply.github.com>

* remove 'file' from top of files

* clean up help message and add endpoint to help

* Fix client stats

* remove unused fn

* Assert on json input format

* Use a single SEND_END point

* Add sync assert. Add OPENAI to helper fn

* remove unused typedef

* Add batch size assert

* Address comment (#487)

* Address comment

* Update src/c++/perf_analyzer/client_backend/openai/openai_client.cc

* Update src/c++/perf_analyzer/client_backend/openai/http_client.cc

* formatting

---------

Co-authored-by: Timothy Gerdes <50968584+tgerdesnv@users.noreply.github.com>
Co-authored-by: tgerdes <tgerdes@nvidia.com>

* Make copy of exported data so it isn't corrupted (#488)

---------

Co-authored-by: oandreeva-nv <oandreeva@nvidia.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: dyastremsky <58150256+dyastremsky@users.noreply.github.com>
debermudez pushed a commit that referenced this pull request Mar 13, 2024
* Add openai service-kind and add endpoint to CLI

* Add openai to model parser

* OpenAI client backend + cmake

* Create OpenAI backend

* New JSON datatype for PA. Show json data available at http_client level

* Add an output to OpenAI models

* Add OpenAI client (#482)

* Add OpenAI client

* Address comment

* Pass endpoint to openai client

* Resolve fixmes

* update copyright years

* more cleanup

* Update src/c++/perf_analyzer/command_line_parser.cc

Co-authored-by: dyastremsky <58150256+dyastremsky@users.noreply.github.com>

* remove 'file' from top of files

* clean up help message and add endpoint to help

* Fix client stats

* remove unused fn

* Assert on json input format

* Use a single SEND_END point

* Add sync assert. Add OPENAI to helper fn

* remove unused typedef

* Add batch size assert

* Address comment (#487)

* Address comment

* Update src/c++/perf_analyzer/client_backend/openai/openai_client.cc

* Update src/c++/perf_analyzer/client_backend/openai/http_client.cc

* formatting

---------

Co-authored-by: Timothy Gerdes <50968584+tgerdesnv@users.noreply.github.com>
Co-authored-by: tgerdes <tgerdes@nvidia.com>

* Make copy of exported data so it isn't corrupted (#488)

---------

Co-authored-by: oandreeva-nv <oandreeva@nvidia.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: dyastremsky <58150256+dyastremsky@users.noreply.github.com>
mc-nv pushed a commit that referenced this pull request Mar 13, 2024
* Add openai service-kind and add endpoint to CLI

* Add openai to model parser

* OpenAI client backend + cmake

* Create OpenAI backend

* New JSON datatype for PA. Show json data available at http_client level

* Add an output to OpenAI models

* Add OpenAI client (#482)

* Add OpenAI client

* Address comment

* Pass endpoint to openai client

* Resolve fixmes

* update copyright years

* more cleanup

* Update src/c++/perf_analyzer/command_line_parser.cc

Co-authored-by: dyastremsky <58150256+dyastremsky@users.noreply.github.com>

* remove 'file' from top of files

* clean up help message and add endpoint to help

* Fix client stats

* remove unused fn

* Assert on json input format

* Use a single SEND_END point

* Add sync assert. Add OPENAI to helper fn

* remove unused typedef

* Add batch size assert

* Address comment (#487)

* Address comment

* Update src/c++/perf_analyzer/client_backend/openai/openai_client.cc

* Update src/c++/perf_analyzer/client_backend/openai/http_client.cc

* formatting

---------

Co-authored-by: Timothy Gerdes <50968584+tgerdesnv@users.noreply.github.com>
Co-authored-by: tgerdes <tgerdes@nvidia.com>

* Make copy of exported data so it isn't corrupted (#488)

---------

Co-authored-by: oandreeva-nv <oandreeva@nvidia.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: dyastremsky <58150256+dyastremsky@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

2 participants