How can I access resources (images, files) sent by the client inside the "Tools"?

[lvitti]

I'm testing the creation of a tool that can receive an image to process it using Python code instead of passing it directly to the model.
How can I access the image uploaded by the user? I tried adding it as a parameter, but I only get a string value like "[img-0]".

This is what I'm trying to use:

class ImageTools(Toolkit):
    def __init__(self):
        super().__init__(name="image_tools")
        self.register(self.process_image)


    def process_image(self, agent: Union[Agent, Team]):

Thanks !

[mishramonalisha76]

Hi @lvitti,
We don’t support this feature just yet, but it’s part of our upcoming priorities and the team is actively working on it. You can expect it to be rolled out soon!

[durandom]

@mishramonalisha76 can you point to a PR or something where this feature is addressed?

[durandom]

Is there an update for this use case?
There's another discussion at #2949 - but I don't think it shows if adding an image to the context is possible via tools.

E.g. an agent with 2 tools.

• list all images
• read image

Similar to the FileTools

[mishramonalisha76]

Hi @durandom , Our team got caught up with other priorities and couldn’t pick this up earlier, but we’ll be working on it soon and aim to roll out this feature shortly.

[durandom]

If there's a proper issue for that or some guidance on how to implement it, I'm happy to help.

[adityarg]

Any updates on this feature?

[kausmeows]

Hi @durandom @adityarg this has been implemented for our 2.0 release here- #4368

It will be launched and released in the next week! Thanks for reporting and building with Agno

[logic-OT]

Hi is there any example of how this works?

[logic-OT]

Also, what about "tools media output'. So when the tool return an image or images, the model sees and interprets them automatically

[kausmeows]

Hi @logic-OT on first one- https://docs.agno.com/concepts/tools/introduction#media-parameters

on second one- https://docs.agno.com/concepts/tools/introduction#toolresult-for-media-content