Hugging Face's logo

Giskard
company
Verified
https://giskard.ai
Giskard-AI
Activity Feed

AI & ML interests

LLM, Agents, Quality, Security, Benchmarking
alexcombessieΒ 
updated a Space 4 months ago
pierljΒ 
in giskardai/realharm 4 months ago

RealHarm
#2 opened 5 months ago by
PhunvVi
davidberenstein1957Β 
posted an update 5 months ago
davidberenstein1957Β 
in giskardai/realperformance 5 months ago

Update README.md

1
#3 opened 5 months ago by
davidberenstein1957
mattbitΒ 
in giskardai/realperformance 5 months ago

Update README.md
#2 opened 5 months ago by
davidberenstein1957
davidberenstein1957Β 
in giskardai/realperformance 5 months ago

Update README.md
#2 opened 5 months ago by
davidberenstein1957
davidberenstein1957Β 
posted an update 5 months ago
view post
Post
390
🚨 LLMs recognise bias but also reproduce harmful stereotypes: an analysis of bias in leading LLMs

I've written a new entry in our series on the Giskard, BPIFrance and Google Deepmind Phare benchmark(phare.giskard.ai).

This time it covers bias: https://huggingface.co/blog/davidberenstein1957/llms-recognise-bias-but-also-produce-stereotypes

Previous entry on hallucinations: https://huggingface.co/blog/davidberenstein1957/phare-analysis-of-hallucination-in-leading-llms
  • 1 reply
Β·
davidberenstein1957Β 
updated a dataset 5 months ago
davidberenstein1957Β 
published a dataset 5 months ago
davidberenstein1957Β 
posted an update 6 months ago
mattbitΒ 
in giskardai/phare 6 months ago

Add link to the paper

1
#5 opened 7 months ago by
nielsr

The technical report link in the readme gives a 404

2
#2 opened 8 months ago by
SDFASDGA
pierljΒ 
updated a dataset 7 months ago
davidberenstein1957Β 
posted an update 7 months ago
julien-cΒ 
posted an update 8 months ago
view post
Post
8260
BOOOOM: Today I'm dropping TINY AGENTS

the 50 lines of code Agent in Javascript πŸ”₯

I spent the last few weeks working on this, so I hope you will like it.

I've been diving into MCP (Model Context Protocol) to understand what the hype was all about.

It is fairly simple, but still quite powerful: MCP is a standard API to expose sets of Tools that can be hooked to LLMs.

But while doing that, came my second realization:

Once you have a MCP Client, an Agent is literally just a while loop on top of it. 🀯

➑️ read it exclusively on the official HF blog: https://huggingface.co/blog/tiny-agents
  • 1 reply
Β·
davidberenstein1957Β 
posted an update 8 months ago
view post
Post
2265
πŸ”₯ Announcing FLUX-Juiced: The Fastest Image Generation Endpoint (2.6x faster)!

Optimisations are widely applied and can reduce inference time, but their impact on quality often remains unclear, so we decided to challenge the status quo and create our own optimised version of FLUX.1[dev] called FLUX-juiced.

Blog: https://huggingface.co/blog/PrunaAI/flux-fastest-image-generation-endpoint
davidberenstein1957Β 
posted an update 8 months ago
davidberenstein1957Β 
posted an update 8 months ago
view post
Post
1406
RealHarm: A Collection of Real-World Language Model Application Failure

I'm David from Giskard, and we work on securing your Agents.
Today, we are launching RealHarm: a dataset of real-world problematic interactions with AI agents, drawn from publicly reported incidents.

Check out the dataset and paper: https://realharm.giskard.ai/
pierljΒ 
authored a paper 8 months ago
davidberenstein1957Β 
posted an update 9 months ago
view post
Post
2110
🚨 New Bonus Unit: Tracing & Evaluating Your Agent! 🚨

Learn how to transform your agent from a simple demo into a robust, reliable product ready for real users.

UNIT: https://huggingface.co/learn/agents-course/bonus-unit2/introduction

In this unit, you'll learn:
- Offline Evaluation – Benchmark and iterate your agent using datasets.
- Online Evaluation – Continuously track key metrics such as latency, costs, and user feedback.

Happy testing and improving!

Thanks Langfuse team!