👷 Join the FREE Code Diagnosis Workshop to help you review code more effectively using my 3-Factor Diagnosis Framework: www.arjancodes.com/diagnosis.

My vote for a jinja2 video!

I’d give Langchain another look. Once your prompts get more complex, you swap LLMs frequently or start rolling in RAG, loops, etc etc, simple API calls and jinja templates will become unmanageable. Even without all of that, Langsmith makes it worthwhile.

I'd be interested in more about your setup and Jinja.

Funny, was just facing the same questions and was playing around. As some others here suggested, I stuck with f-strings for now, as it removes a fairly big dependency and when developing I like to see the prompt as I am playing around with it. But in Production this can be a huge cleanup in the code!

I've started using Jinja for my prompts mainly because I found myself converting lists into strings with a line break just to be well-formatted. Another problem it solved was that my IDE always complained about lines over 79 characters, which is pretty common for prompts. I know it is possible to break the strings into multiple lines, but I think it is too much work when the prompt starts getting bigger. F-strings don't work well if you have to put some examples of JSON into the prompt, a common use if you are using the LLM to extract data from an unstructured text.

In the 60s some professors raised a chimp in a human family enviroment. Hoping the chimp become more human. The oposite happen the child becames more chimp. Here you exemplify this perfectly, in the hope of get more context information from the machine, you satart being less human and more machine like. Obviusly you are the inteligent part. Love your channel.

In my company we use jinga2 for code generation, it's also very nice for that

For those that are going to use Jinja, please note that it breaks easily, if anything changes. So make a FULL requirements.txt file, AND note the python version you have tested it with. I cannot count how many times I come back to a Jinja script a month later, and it does not work because something has been updated...

@TangoFoxtrotWhiskey

2 ай бұрын

And there was that time when they broke Flask, and the response was, "don't trust semver, lol."

so its f strings?

@feldinho

2 ай бұрын

Imagine a whole file as a big fstring. That's Jinja. :)

@EWILD99

2 ай бұрын

@@feldinho i mean i have prompts in my job i use for agents that are 1k tokens long and i literally just use an f string lol

@petermleigh

2 ай бұрын

Arjan's use case is probably best with f-strings. Jinja is really good for embedding conditional statements and loops into your template, like creating HTML tables from a dictionary.

@maleldil1

2 ай бұрын

@@petermleigh not f-strings because you want to store a template in the file. Rather, you'd use str.format.

@TheEvertw

2 ай бұрын

Templates separate the String from the code used to render it. They make it easier to imagine how a rendered document is going look, than having dozens of f-strings sprinkled throughout one or more code files. If you just want a single prompt, an f-string is fine. If you want a document generated from a data set, use Jinja2 (or another templating engine, like Mako or Django).

I have been using txt files, and they have worked perfectly for me

Jinja2 is great when you can re-use your special formatting over several templates. It is a bit restrictive but that makes writing correct templates easier. I use templates a lot for code generation, where the templates have almost no overlap, meaning there is very little re-use of special formatting filters. In that case, Mako is more powerful. But Mako is harder to debug.

marvin, pydantic, instructor, langchain and now I'm going to try jinj2 in that mix

I have a similar setup to this but I use functions with f strings. It's not entirely easy to read but I like that each prompt it a function that I can put behind a factory. I might pivot to jinja though for some things. Langchain however is a complicated mess and I hate it

It just hurts that the image showcase a shinobi (aka ninja) instead of a shrine (jinja). The words are not even related at all...

curious, why not use yield and streaming response to give a better user experience ?

0:34 please do a langchain roast video. I've also been using it for my stuff and getting both frustrated and confused the MORE familiar I become with it, which feels backwards.

f-strings work fine for me but i don't have conditional logic (yet!)

How is this different from storing a format string as a file, then reading it and using prompt.format(...)? It seems overkill to use a whole templating engine for something so simple.

@ArjanCodes

2 ай бұрын

Having the option to use conditional statements and other more advanced template features is really helpful, and that's not possible with f-strings. I'm using this in our Learntail platform quite a bit. I didn't have time to go over those things as this was supposed to be a short video, but if you're interested, I can do a longer video about it.

@emperorsixpacks

2 ай бұрын

Would love an in-depth video 😊

Not to sound mean but it doesn't really convince me to use Jinja now. the same thing can be achieved using something like "{hello}".format(hello="sup") and no matter where you keep the string template. What'd work better is showing off some smart features Jinja does (of which i am not aware tho).

@sorvex9

2 ай бұрын

Did you even pay attention? If you use all the features you can store the jinja templates seperate from your Python code, with complex Logic like conditionals and loops - which is the whole point of using them

@MrChronoJon

2 ай бұрын

If you would change similar products to an array of strings that could be empty, you can handle the simple logic around that directly in the template. Otherwise you would have to build up the format string (to handle the empty case) and join the product strings beforehand. Also, you can put parts of the template into different files and recompose in order to avoid duplication of template components and possibly having slightly different versions of the same thing in multiple places. If it becomes slightly more complicated then you will probably end up writing your own template engine or you could just use jinja.

first!