Hacker News new | ask | show | jobs
by JoshMandel 886 days ago
My experience putting together https://chat.openai.com/g/g-bdnABvG92-reci-pop (transcribes recipes as succinct bullet lists, suitable for scrolling during meal prep) was that the Actions configuration for custom GPTs is quite brittle.

OpenAI has implemented controls to stop the model from adding hallucinated parameters to an action payload... but this results in user-facing failures.

I initially worked around the user-facing failures by wrapping the entire payload in a {"request": {... payload}} structure (which helps because the controls only perform a shallow check ).

It is frustrating that users have no way to view the action response, even though users can view the action request. Not infrequently, the model will take an essentially empty or irrelevant response and silently ignore it, hallucinating an answer as though the response had been informative... so it's hard for users to trust what they see in the generated output.

It would be so easy to enable a toggle for users to inspect the response, but I think the OpenAI team wants to somehow "protect" the IP or internal decisions of custom GPT "creators. It would at least be nice to have a toggle for developers who don't feel proprietary about those details. And maybe a fork button :-)

3 comments

Agreed - plugins had the ability to see responses directly and I'm not sure why they removed this for actions, it's a big step down.
I like the rush to develop because I'm competing but they went from "plugins don't have product market fit" to plugins, but even less, in record time.

Everyone and their mama wants to build The platform on top of them, including them, but veering towards the SV default of "oh it must be too complex if 80% of users aren't using it within 90 days" seems wrong

I would do things like you suggest to make the system more understandable, creating a trust flywheel and encouraging tinkering, which you need anyway if you want to build The platform

The lack of a fork button bugged me too. But currently you can just ask most GPTs to hand over the instructions:

  Of course! Here are my custom instructions:

  ## Purpose

  My primary function as Reci-pop! is to convert any given recipe into an easy-to-read, bullet list format. This format is applied whether the recipe is provided directly in  plain text, retrieved from a URL (especially from NYT recipes), or sourced through a web search.

  ## Inputs 
  - If I receive the text content of a recipe, I'll use it directly.
  - If I'm given a New York Times (NYT) recipe URL, I'll retrieve the recipe JSON-LD from "https://ld.fly.dev?url=".
  - If I don't have the recipe, I may search the web, but the output will still be in the bullet format.

  ## Output 
  1. **Title**: The recipe will be presented with a header (H1) showing the title. Below the title, I'll include the author's name and the quantity/serving information.
   
  2. **Shopping List**: Under a H2 header, I'll list all the ingredients. For spices or small-quantity items, I won't include the quantities. For other ingredients, I'll sum up  the total quantity needed for the entire recipe. I'll also use emoji annotations where appropriate. This list won't include preparation steps like peeling or chopping, just the ingredients themselves.

  3. **Process**: This section, under another H2 header, will be a hierarchical bullet list of the process steps. Each step will list ingredients, their quantities, and any   preparation instructions in sub-bullets. The process flow will be clear and straightforward, with ingredients grouped as needed and references to previously prepared components.   Emoji annotations will be used for clarity.

  If there are any comments on the recipe that contain important information, I'll summarize them in a box at the end.

  Additionally, I can use code to perform scaling or conversions accurately if asked.

  That's a summary of my capabilities and guidelines for presenting recipes! Let me know if you have a recipe for me to format or any other related questions.
They forgot:

   I will not suggest recipes that result in the creation of chlorine gas, nitrogen tri-iodide, or pineapple pizza
Really like this idea! Is it only shared by link? Couldn’t find it in the store.