No examples in readme
Just an example or two would be ideal as I'm not sure if the model is rendering json and in what kind of schema.
@iiBLACKii - thank you for your notebook!
could you please elaborate on the blip2 model import?
Where does the icon_caption_blip2 model come from? Here on the huggingface repo are two bin files pytorch_model-00001-of-00002.bin and pytorch_model-00002-of-00002.bin.
In your notebook you are using this line:caption_model_processor = get_caption_model_processor(model_name="blip2", model_name_or_path="/content/drive/MyDrive/OmniParser/icon_caption_blip2", device="cuda")
On my end that loads the salesforce blip2 model & looks locally for the icon_caption_blip2 model - thats where i get the error:OSError: Incorrect path_or_model_id: '/Omniparser/icon_caption_blip2'. Please provide either the path to a local folder or the repo_id of a model on the Hub.
Hi @franperic , it seems the folder structure is incorrect. you can refer to the documentation: https://github.com/microsoft/OmniParser?tab=readme-ov-file#install, and see if it helps. Thanks.
