Not like regular output caching (think database).
- Cache only the input prompt not the output.
- Model computes key value pairs at every transformer layer
- Cache stores the computed kv pairs
Context Window Contents - Doc
- Summary
https://www.youtube.com/watch?v=xaQG-eD9d58&t=1s
If you are using AI model as the Oracle you are in the wrong frame of mind.
Assign tasks don't ask questions. a) Describe the end state you want b) Provide the success criteria b) Let the system decide how to get there
Accept imperfections and start to iterate a) Ralph Wiggum works because it produces broken code b) Make it retry until it fixes it
Let the model write the code - Self acceleration loop - Use AI to make AI better
Unlike traditional software, they learn and adapt in realtime - Decide on actions after interpreting data - Not just following scripts - Attackers manipulate sensing, thinking or acting functions - They can hijack the whole process
Need to build in safeguards - Make sure it stays under my control - Continues to follow my instructions
From Daniel Miessler LI post
The ability to verify or 'Hill Climb' on general tasks instead of just coding.
Based on all the research papers I updloaded, create a comprehensive literature review covering: key arguments, methodological gaps, and underexplored research opportunities.
Compare the marketing strategy in Document A with user feedback in Document B, identify three potential misalignments between strategy and real user needs.
https://www.youtube.com/watch?v=EH8Mdx948Kw
Reasoning mode enabled
| Get-WindowsCapability -Online | Where-Object Name -like 'OpenSSH*' |