Export
Introduction
In this notebook, we'll explore Qwen3-VL's "recognize anything" capabilities using Together AI's API. The model can recognize:
- Celebrities and public figures
- Anime characters
- Food items (with multilingual names)
- Landmarks and locations
- And much more!
We'll also explore object spotting with bounding boxes.
Install required libraries
[ ]
[3]
Using model: Qwen/Qwen3.5-397B-A17B API Key configured: True
[4]
1. Object Recognition
Identify objects, people, or characters in images.
[5]
This is the famous "Oscars selfie" taken at the 2014 Academy Awards. The photo was taken by Bradley Cooper and features a group of celebrities posing together. From left to right and front to back, the people in the image are: **Front row (left to right):** - **Jennifer Lawrence** – in the red dress, smiling widely. - **Ellen DeGeneres** – in the white blazer, taking the selfie with Bradley Cooper. - **Bradley Cooper** – in the foreground, taking the selfie. **Back row (left to right):** - **Angelina Jolie** – partially visible on the far left, behind Jennifer Lawrence. - **Brad Pitt** – smiling, wearing a tuxedo. - **Channing Tatum** – behind Brad Pitt, smiling. - **Meryl Streep** – behind Bradley Cooper, wearing glasses and laughing. - **Lupita Nyong’o** – behind Brad Pitt, smiling broadly. - **Kevin Spacey** – behind Channing Tatum, wearing a bow tie. - **Diane Keaton** – behind Meryl Streep, waving. - **Janelle Monáe** – behind Lupita Nyong’o, partially visible. - **Alfonso Cuarón** – not clearly visible, but sometimes included in descriptions (though not clearly identifiable here). - **Ellen’s arm and hand** – visible on the far right, holding the phone. This photo became a viral sensation and is one of the most iconic moments from the 2014 Oscars. It was taken during the live broadcast and shared on Twitter by Ellen DeGeneres, breaking records for retweets at the time.
2. Object Spotting
Identify multiple objects and return their bounding boxes and names.
Note: Coordinates use relative scale from 0 to 1000.
[6]
{
"objects": [
{
"bbox_2d": [
0,
309,
104,
634
],
"label_en": "assorted breads and pretzels",
"label_zh": "\u5404\u79cd\u9762\u5305\u548c\u6912\u76d0\u5377\u997c"
},
{
"bbox_2d": [
96,
333,
233,
468
],
"label_en": "bagels and rolls",
"label_zh": "\u767e\u5409\u997c\u548c\u9762\u5305\u5377"
},
{
"bbox_2d": [
154,
475,
288,
660
],
"label_en": "sushi rolls with salmon and cream cheese",
"label_zh": "\u4e09\u6587\u9c7c\u548c\u5976\u6cb9\u5976\u916a\u5bff\u53f8\u5377"
},
{
"bbox_2d": [
27,
655,
157,
852
],
"label_en": "watermelon slices",
"label_zh": "\u897f\u74dc\u7247"
},
{
"bbox_2d": [
198,
667,
327,
861
],
"label_en": "chocolate cookies",
"label_zh": "\u5de7\u514b\u529b\u997c\u5e72"
},
{
"bbox_2d": [
296,
479,
407,
640
],
"label_en": "sushi rolls with seaweed and rice",
"label_zh": "\u6d77\u82d4\u7c73\u996d\u5bff\u53f8\u5377"
},
{
"bbox_2d": [
353,
283,
419,
484
],
"label_en": "shrimp with lime wedges",
"label_zh": "\u914d\u9752\u67e0\u89d2\u7684\u867e"
},
{
"bbox_2d": [
350,
711,
447,
864
],
"label_en": "salad with greens and dressing",
"label_zh": "\u914d\u9171\u6c41\u7684\u7eff\u8272\u6c99\u62c9"
},
{
"bbox_2d": [
447,
667,
571,
867
],
"label_en": "mini egg tarts",
"label_zh": "\u8ff7\u4f60\u86cb\u631e"
},
{
"bbox_2d": [
457,
441,
609,
664
],
"label_en": "green salad with cherry tomatoes and wooden spoons",
"label_zh": "\u914d\u6a31\u6843\u756a\u8304\u548c\u6728\u52fa\u7684\u7eff\u8272\u6c99\u62c9"
},
{
"bbox_2d": [
464,
233,
585,
452
],
"label_en": "spring rolls with herbs and dipping sauce",
"label_zh": "\u914d\u9999\u8349\u548c\u8638\u9171\u7684\u6625\u5377"
},
{
"bbox_2d": [
412,
305,
468,
383
],
"label_en": "yellow curry or sauce",
"label_zh": "\u9ec4\u8272\u5496\u55b1\u6216\u9171\u6c41"
},
{
"bbox_2d": [
415,
377,
470,
479
],
"label_en": "black and white olives",
"label_zh": "\u9ed1\u6a44\u6984\u548c\u767d\u6a44\u6984"
},
{
"bbox_2d": [
407,
567,
460,
647
],
"label_en": "roasted chickpeas or beans",
"label_zh": "\u70e4\u9e70\u5634\u8c46\u6216\u8c46\u7c7b"
},
{
"bbox_2d": [
407,
479,
460,
555
],
"label_en": "curried vegetables or lentils",
"label_zh": "\u5496\u55b1\u852c\u83dc\u6216\u6241\u8c46"
},
{
"bbox_2d": [
581,
355,
673,
502
],
"label_en": "cheese crisps or tortilla chips",
"label_zh": "\u5976\u916a\u8106\u7247\u6216\u7389\u7c73\u7247"
},
{
"bbox_2d": [
654,
441,
720,
544
],
"label_en": "crispy crackers or flatbread",
"label_zh": "\u8106\u997c\u5e72\u6216\u8584\u997c"
},
{
"bbox_2d": [
740,
400,
827,
533
],
"label_en": "yellow rice or couscous",
"label_zh": "\u9ec4\u8272\u7c73\u996d\u6216\u7c97\u9ea6\u7c89"
},
{
"bbox_2d": [
841,
405,
904,
500
],
"label_en": "tomato-based stew or curry",
"label_zh": "\u756a\u8304\u7096\u83dc\u6216\u5496\u55b1"
},
{
"bbox_2d": [
841,
316,
907,
400
],
"label_en": "green soup or broth",
"label_zh": "\u7eff\u8272\u6c64\u6216\u9ad8\u6c64"
},
{
"bbox_2d": [
912,
341,
977,
433
],
"label_en": "spicy curry with lime",
"label_zh": "\u914d\u9752\u67e0\u7684\u8f9b\u8fa3\u5496\u55b1"
},
{
"bbox_2d": [
920,
433,
985,
525
],
"label_en": "dark stew or chocolate sauce",
"label_zh": "\u6df1\u8272\u7096\u83dc\u6216\u5de7\u514b\u529b\u9171"
},
{
"bbox_2d": [
815,
508,
870,
594
],
"label_en": "yellow broth or tea",
"label_zh": "\u9ec4\u8272\u9ad8\u6c64\u6216\u8336"
},
{
"bbox_2d": [
897,
525,
940,
594
],
"label_en": "red sauce or chutney",
"label_zh": "\u7ea2\u8272\u9171\u6599\u6216\u9178\u8fa3\u9171"
},
{
"bbox_2d": [
705,
533,
745,
594
],
"label_en": "yellow dip or sauce",
"label_zh": "\u9ec4\u8272\u8638\u9171\u6216\u9171\u6599"
},
{
"bbox_2d": [
645,
550,
685,
608
],
"label_en": "spiced nuts or seeds",
"label_zh": "\u9999\u6599\u575a\u679c\u6216\u79cd\u5b50"
},
{
"bbox_2d": [
727,
588,
770,
647
],
"label_en": "red chili or tomato sauce",
"label_zh": "\u7ea2\u8fa3\u6912\u6216\u756a\u8304\u9171"
},
{
"bbox_2d": [
597,
608,
755,
783
],
"label_en": "grilled lobster with lemon",
"label_zh": "\u914d\u67e0\u6aac\u7684\u70e4\u9f99\u867e"
},
{
"bbox_2d": [
795,
583,
840,
679
],
"label_en": "vegetable medley or salad",
"label_zh": "\u852c\u83dc\u62fc\u76d8\u6216\u6c99\u62c9"
},
{
"bbox_2d": [
847,
577,
895,
675
],
"label_en": "stuffed mushrooms or vegetables",
"label_zh": "\u917f\u8611\u83c7\u6216\u852c\u83dc"
},
{
"bbox_2d": [
905,
583,
955,
679
],
"label_en": "stuffed vegetables or eggplant",
"label_zh": "\u917f\u852c\u83dc\u6216\u8304\u5b50"
},
{
"bbox_2d": [
955,
594,
999,
688
],
"label_en": "rice or grain bowl",
"label_zh": "\u7c73\u996d\u6216\u8c37\u7269\u7897"
},
{
"bbox_2d": [
895,
683,
991,
825
],
"label_en": "green beans and roasted meat",
"label_zh": "\u9752\u8c46\u548c\u70e4\u8089"
},
{
"bbox_2d": [
735,
725,
830,
861
],
"label_en": "cheese and herb plate with fork and spoon",
"label_zh": "\u914d\u53c9\u5b50\u548c\u52fa\u5b50\u7684\u5976\u916a\u548c\u9999\u8349\u76d8"
},
{
"bbox_2d": [
225,
302,
340,
479
],
"label_en": "green salad in glass bowl",
"label_zh": "\u73bb\u7483\u7897\u4e2d\u7684\u7eff\u8272\u6c99\u62c9"
},
{
"bbox_2d": [
165,
194,
255,
338
],
"label_en": "mixed salad with avocado and lime",
"label_zh": "\u914d\u725b\u6cb9\u679c\u548c\u9752\u67e0\u7684\u6df7\u5408\u6c99\u62c9"
},
{
"bbox_2d": [
565,
159,
655,
288
],
"label_en": "vegetable salad with dressing",
"label_zh": "\u914d\u9171\u6c41\u7684\u852c\u83dc\u6c99\u62c9"
},
{
"bbox_2d": [
660,
272,
775,
444
],
"label_en": "green leafy salad with wooden spoons",
"label_zh": "\u914d\u6728\u52fa\u7684\u7eff\u8272\u53f6\u83dc\u6c99\u62c9"
},
{
"bbox_2d": [
345,
144,
438,
279
],
"label_en": "meat dish with fork and knife",
"label_zh": "\u914d\u53c9\u5b50\u548c\u5200\u7684\u8089\u7c7b\u83dc\u80b4"
},
{
"bbox_2d": [
815,
194,
897,
309
],
"label_en": "grilled meat with vegetables",
"label_zh": "\u914d\u852c\u83dc\u7684\u70e4\u8089"
},
{
"bbox_2d": [
587,
288,
640,
362
],
"label_en": "roasted chickpeas or beans",
"label_zh": "\u70e4\u9e70\u5634\u8c46\u6216\u8c46\u7c7b"
},
{
"bbox_2d": [
330,
667,
372,
725
],
"label_en": "small bowl of dip or sauce",
"label_zh": "\u5c0f\u7897\u8638\u9171\u6216\u9171\u6599"
}
]
}
[7]
{
"objects": [
{
"bbox_2d": [
20,
312,
160,
1000
],
"label_en": "Vegeta",
"label_zh": "\u8d1d\u5409\u5854"
},
{
"bbox_2d": [
170,
522,
320,
1000
],
"label_en": "Gohan (child)",
"label_zh": "\u609f\u996d\uff08\u7ae5\u5e74\uff09"
},
{
"bbox_2d": [
73,
12,
430,
1000
],
"label_en": "Piccolo",
"label_zh": "\u6bd4\u514b"
},
{
"bbox_2d": [
290,
306,
440,
1000
],
"label_en": "Trunks (future)",
"label_zh": "\u7279\u5170\u514b\u65af\uff08\u672a\u6765\uff09"
},
{
"bbox_2d": [
380,
44,
600,
1000
],
"label_en": "Goku",
"label_zh": "\u5b59\u609f\u7a7a"
},
{
"bbox_2d": [
550,
228,
730,
1000
],
"label_en": "Gohan (teen)",
"label_zh": "\u609f\u996d\uff08\u5c11\u5e74\uff09"
},
{
"bbox_2d": [
590,
534,
740,
1000
],
"label_en": "Goten",
"label_zh": "\u609f\u5929"
},
{
"bbox_2d": [
730,
156,
970,
1000
],
"label_en": "Tien",
"label_zh": "\u5929\u6d25\u996d"
},
{
"bbox_2d": [
760,
698,
900,
1000
],
"label_en": "Chiaotzu",
"label_zh": "\u5c0f\u6797"
}
]
}