@@ -206,10 +206,10 @@ Set the values of the variables:
206
206
207
207
By default, LVM models are set to a default value as listed below :
208
208
209
- | Service | Model |
210
- | --------- | ------------------- ------------------------ |
211
- | LVM | llava-hf/llava-1.5-7b-hf |
212
- | LVM | Xkev/Llama-3.2V-11B-cot |
209
+ | Service | Model |
210
+ | ------- | ------------------------ |
211
+ | LVM | llava-hf/llava-1.5-7b-hf |
212
+ | LVM | Xkev/Llama-3.2V-11B-cot |
213
213
214
214
Note :
215
215
@@ -253,7 +253,6 @@ All containers should be running and should not restart:
253
253
- visualqna-rocm-ui-server
254
254
- visualqna-rocm-nginx-server
255
255
256
-
257
256
# #### If you use TGI:
258
257
259
258
- visualqna-tgi-service
@@ -353,25 +352,25 @@ then we consider the vLLM service to be successfully launched
353
352
# ## 3. Validate the MegaService
354
353
355
354
` ` ` bash
356
- DATA='{
357
- "messages": [
358
- {
359
- "role": "user",
360
- "content": [
361
- {
362
- "type": "text",
363
- "text": "What'\' 's in this image?"
364
- },
365
- {
366
- "type": "image_url",
367
- "image_url": {
368
- "url": "https://www.ilankelman.org/stopsigns/australia.jpg"
369
- }
370
- }
371
- ]
372
- }
373
- ],
374
- "max_tokens": 300
355
+ DATA='{
356
+ "messages": [
357
+ {
358
+ "role": "user",
359
+ "content": [
360
+ {
361
+ "type": "text",
362
+ "text": "What'\' 's in this image?"
363
+ },
364
+ {
365
+ "type": "image_url",
366
+ "image_url": {
367
+ "url": "https://www.ilankelman.org/stopsigns/australia.jpg"
368
+ }
369
+ }
370
+ ]
371
+ }
372
+ ],
373
+ "max_tokens": 300
375
374
}'
376
375
377
376
curl http://${HOST_IP}:${VISUALQNA_BACKEND_SERVICE_PORT}/v1/visualqna \
@@ -397,7 +396,7 @@ A page should open when you click through to this address:
397
396
If a page of this type has opened, then we believe that the service is running and responding,
398
397
and we can proceed to functional UI testing.
399
398
400
- To check that service is working push on one of the example pictures and whait for the answer :
399
+ To check that service is working push on one of the example pictures and whait for the answer :
401
400
402
401

403
402
0 commit comments