llm/SIA
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Document all actions

Browse Source
This commit is contained in:
Geens
2024-10-20 14:28:35 +02:00
parent 0015e2731a
commit 8114e98bce
1 changed files with 628 additions and 15 deletions
Download Patch File Download Diff File Expand all files Collapse all files

643
readme.md
View File

@@ -9,7 +9,8 @@ The system implements reinforcement learning by analyzing past iterations to imp
SIA can also modify its own source code, allowing it to adapt to new challenges. SIA can also modify its own source code, allowing it to adapt to new challenges.
## Working principles ## Working principles
This section gives a high-level overview of the main components of SIA and how they work together.
High-level overview of the main components of SIA and how they work together.
### LLM-Powered Reasoning ### LLM-Powered Reasoning
@@ -190,6 +191,7 @@ The pre and post files are optional.
To do an actual training round, a sia:latest container is started. To do an actual training round, a sia:latest container is started.
This is an example action that trains on two datasets with learning rate 0.1: This is an example action that trains on two datasets with learning rate 0.1:
```xml ```xml
<start_container image="sia:latest" volumes="/tasks:/tasks"> <start_container image="sia:latest" volumes="/tasks:/tasks">
<volumes> <volumes>
@@ -198,15 +200,15 @@ This is an example action that trains on two datasets with learning rate 0.1:
<volume>/datasets/description_of_nother_problem/:/datasets/description_of_nother_problem/</volume> <volume>/datasets/description_of_nother_problem/:/datasets/description_of_nother_problem/</volume>
</volumes> </volumes>
<command>sia</command> <command>sia</command>
<parameter>train</parameter> <argument>train</argument>
<parameter>--learning-rate</parameter> <argument>--learning-rate</argument>
<parameter>0.1</parameter> <argument>0.1</argument>
<parameter>--model</parameter> <argument>--model</argument>
<parameter>/models/2024_10_19_08_21_41</parameter> <argument>/models/2024_10_19_08_21_41</argument>
<parameter>--out</parameter> <argument>--out</argument>
<parameter>/models/2024_10_19_15_03_52</parameter> <argument>/models/2024_10_19_15_03_52</argument>
<parameter>/datasets/description_of_a_problem/</parameter> <argument>/datasets/description_of_a_problem/</argument>
<parameter>/datasets/description_of_nother_problem/</parameter> <argument>/datasets/description_of_nother_problem/</argument>
</start_container> </start_container>
``` ```
@@ -222,12 +224,616 @@ The web interface takes over standard input and output.
It each time the LLM generates a response, the web interface will display it. It each time the LLM generates a response, the web interface will display it.
The user can modify the response before the actions are executed. The user can modify the response before the actions are executed.
## Actions
A list of all available core actions.
Indicating how they are implemented and how SIA can use them.
### Read standard input
Module: Process
#### Function declaration
```python
def read_stdin(n: int = -1) -> str:
''' Read n bytes from standard input.
Args:
n: int, The number of bytes to read; -1 for all available bytes (default: -1)
'''
pass
```
#### Schema
```xml
<?xml version="1.0" encoding="UTF-8"?>
<xs:schema xmlns:xs="http://www.w3.org/2001/XMLSchema">
<xs:element name="read_stdin">
<xs:complexType>
<xs:attribute name="n" type="xs:integer" use="optional"/>
</xs:complexType>
</xs:element>
</xs:schema>
```
#### Example
```xml
<read_stdin n="42"/>
```
#### Results
An attribute `actual` is added with the amount of bytes read.
A text node is added with the data as `CDATA`.
### Write to standard output
Module: Process
Function declaration
```python
def write_stdout(text: str) -> None:
''' Write text to standard output. '''
pass
```
Schema
```xml
<?xml version="1.0" encoding="UTF-8"?>
<xs:schema xmlns:xs="http://www.w3.org/2001/XMLSchema">
<xs:element name="write_stdout">
<xs:complexType>
<xs:simpleContent>
<xs:extension base="xs:string"/>
</xs:simpleContent>
</xs:complexType>
</xs:element>
</xs:schema>
```
Example
```xml
<write_stdout>Hello world!</write_stdout>
```
#### Results
No information is added.
### Monitor file
Module: Process
#### Function declaration
```python
def monitor_file(path: str, offset: int = 0, length: int = -1, unit: str = 'bytes') -> None:
''' Monitor a file for changes.
Parameters:
- path: str, the path to the file to monitor
- offset: int, the starting point for reading (default: 0)
- length: int, the amount to read; -1 means read to end (default: -1)
- unit: str, 'bytes' or 'lines' (default: 'bytes')
'''
pass
```
#### Schema
```xml
<?xml version="1.0" encoding="UTF-8"?>
<xs:schema xmlns:xs="http://www.w3.org/2001/XMLSchema">
<xs:element name="monitor_file">
<xs:complexType mixed="true">
<xs:simpleContent>
<xs:extension base="xs:string">
<xs:attribute name="offset" type="xs:integer" use="optional"/>
<xs:attribute name="length" type="xs:integer" use="optional"/>
<xs:attribute name="unit" use="optional">
<xs:simpleType>
<xs:restriction base="xs:string">
<xs:enumeration value="bytes"/>
<xs:enumeration value="lines"/>
</xs:restriction>
</xs:simpleType>
</xs:attribute>
</xs:extension>
</xs:simpleContent>
</xs:complexType>
</xs:element>
</xs:schema>
```
#### Example
```xml
<monitor_file offset="12" unit="lines">
/context_history/2024_10_20/13_43_51.56
</monitor_file>
```
#### Results
No information is added.
The monitored files are added to the context separately with an id.
### Unmonitor file
Module: Process
#### Function declaration
```python
def unmonitor_file(path: str = None, id: int = None) -> None:
''' Unmonitor a file.
Parameters:
- path: str, the path to the file
- id: int, the id of the file as indicated in the context
Either path or id must be provided.
'''
```
#### Schema
```xml
<?xml version="1.0" encoding="UTF-8"?>
<xs:schema xmlns:xs="http://www.w3.org/2001/XMLSchema">
<xs:element name="unmonitor_file">
<xs:complexType>
<xs:simpleContent>
<xs:extension base="xs:string">
<xs:attribute name="id" type="xs:integer" use="optional"/>
</xs:extension>
</xs:simpleContent>
</xs:complexType>
</xs:element>
</xs:schema>
```
#### Example
```xml
<unmonitor_file id="3"/>
<unmonitor_file>
/context_history/2024_10_20/13_43_51.56
</unmonitor_file>
```
#### Results
No information is added.
### Start container
Module: Docker
#### Function declaration
```python
def start_container(
image: str,
name: str = None,
timeout: int = -1,
command: str = None,
arguments: List[str] = None,
volumes: Dict[str, str] = None, # host_path: container_path
ports: Dict[str, str] = None, # host_port: container_port
environment: Dict[str, str] = None, # key: value
) -> None:
"""Start a new Docker container with the specified configuration.
Args:
image: Docker image to use
name: Unique container name for long running containers
timeout: Timeout in milliseconds for short running containers
command: Main command to run in container
arguments: List of command line arguments
volumes: Dictionary mapping host paths to container paths
ports: Dictionary mapping host ports to container ports
environment: Dictionary of environment variables and values
name or timeout must be provided.
Example:
start_container(
image="busybox:latest",
timeout=1000,
command="sh",
arguments=["-c", "echo 'Hello' > /data/output.txt"],
volumes={
"/host/data": "/data",
"/host/config": "/config"
},
ports={
"8080": "80",
"2222": "22"
},
environment={
"DEBUG": "1",
"API_KEY": "secret123"
}
)
"""
pass
```
#### Schema
```xml
<?xml version="1.0" encoding="UTF-8"?>
<xs:schema xmlns:xs="http://www.w3.org/2001/XMLSchema">
<xs:element name="start_container">
<xs:complexType>
<xs:sequence>
<xs:element name="command" type="xs:string" minOccurs="0"/>
<xs:element name="argument" type="xs:string" minOccurs="0" maxOccurs="unbounded"/>
<xs:element name="volumes" minOccurs="0">
<xs:complexType>
<xs:sequence>
<xs:element name="volume" type="xs:string" maxOccurs="unbounded"/>
</xs:sequence>
</xs:complexType>
</xs:element>
<xs:element name="ports" minOccurs="0">
<xs:complexType>
<xs:sequence>
<xs:element name="port" maxOccurs="unbounded">
<xs:complexType>
<xs:simpleContent>
<xs:extension base="xs:string">
<xs:attribute name="host" type="xs:string" use="required"/>
<xs:attribute name="container" type="xs:string" use="required"/>
</xs:extension>
</xs:simpleContent>
</xs:complexType>
</xs:element>
</xs:sequence>
</xs:complexType>
</xs:element>
<xs:element name="environment" minOccurs="0">
<xs:complexType>
<xs:sequence>
<xs:element name="variable" maxOccurs="unbounded">
<xs:complexType>
<xs:simpleContent>
<xs:extension base="xs:string">
<xs:attribute name="name" type="xs:string" use="required"/>
</xs:extension>
</xs:simpleContent>
</xs:complexType>
</xs:element>
</xs:sequence>
</xs:complexType>
</xs:element>
</xs:sequence>
<xs:attribute name="image" type="xs:string" use="required"/>
<xs:attribute name="name" type="xs:string" use="optional"/>
<xs:attribute name="timeout" type="xs:integer" use="optional"/>
<xs:attribute name="volumes" type="xs:string" use="optional"/>
</xs:complexType>
</xs:element>
</xs:schema>
```
#### Example
```xml
<start_container
image="busybox:latest"
timeout="1000">
<command>sh</command>
<argument>-c</argument>
<argument><![CDATA[echo 'Hello' > /data/output.txt]]></argument>
<volumes>
<volume>/host/data:/data</volume>
<volume>/host/config:/config</volume>
</volumes>
<ports>
<port host="8080" container="80"/>
<port host="2222" container="22"/>
</ports>
<environment>
<variable name="DEBUG">1</variable>
<variable name="API_KEY">secret123</variable>
</environment>
</start_container>
```
#### Results
For short running containers, the exit status is added as attribute.
Standard output and standard error are merged and added as `CDATA` text node.
For long running containers, no information is added.
The container is started and represented in the containers section of the main context.
### Stop container
Module: Docker
#### Function declaration
```python
def stop_container(name: str) -> None:
"""Stop a Docker container by name.
Args:
name: Name of the container to stop
"""
pass
```
#### Schema
```xml
<?xml version="1.0" encoding="UTF-8"?>
<xs:schema xmlns:xs="http://www.w3.org/2001/XMLSchema">
<xs:element name="stop_container">
<xs:complexType>
<xs:simpleContent>
<xs:extension base="xs:string"/>
</xs:simpleContent>
</xs:complexType>
</xs:element>
</xs:schema>
```
#### Example
```xml
<stop_container>my-long-running-container</stop_container>
```
#### Results
No information is added.
The container will be removed from the containers section of the main context.
### Write to container standard input
Module: Docker
#### Function declaration
```python
def write_container_stdin(name: str, data: str) -> None:
"""Write data to a container's standard input.
Args:
name: Name of the target container
data: Data to write to stdin
"""
pass
```
#### Schema
```xml
<?xml version="1.0" encoding="UTF-8"?>
<xs:schema xmlns:xs="http://www.w3.org/2001/XMLSchema">
<xs:element name="write_container_stdin">
<xs:complexType>
<xs:simpleContent>
<xs:extension base="xs:string">
<xs:attribute name="container" type="xs:string" use="required"/>
</xs:extension>
</xs:simpleContent>
</xs:complexType>
</xs:element>
</xs:schema>
```
#### Example
```xml
<write_container_stdin container="interactive-shell">ls -la</write_container_stdin>
```
#### Results
No information is added.
The data will be written to the container's stdin buffer.
### Read from container standard output
Module: Docker
#### Function declaration
```python
def read_container_stdout(name: str, n: int = -1) -> str:
"""Read from a container's standard output buffer.
Args:
name: Name of the container
n: Number of bytes to read; -1 means read all available (default: -1)
Returns:
Data read from stdout
"""
pass
```
#### Schema
```xml
<?xml version="1.0" encoding="UTF-8"?>
<xs:schema xmlns:xs="http://www.w3.org/2001/XMLSchema">
<xs:element name="read_container_stdout">
<xs:complexType>
<xs:attribute name="container" type="xs:string" use="required"/>
<xs:attribute name="n" type="xs:integer" use="optional"/>
</xs:complexType>
</xs:element>
</xs:schema>
```
#### Example
```xml
<read_container_stdout container="interactive-shell" n="1024"/>
```
#### Results
An attribute `actual` is added with the amount of bytes read.
A text node is added with the data as `CDATA`.
### Read from container standard error
Module: Docker
#### Function declaration
```python
def read_container_stderr(name: str, n: int = -1) -> str:
"""Read from a container's standard error buffer.
Args:
name: Name of the container
n: Number of bytes to read; -1 means read all available (default: -1)
Returns:
Data read from stderr
"""
pass
```
#### Schema
```xml
<?xml version="1.0" encoding="UTF-8"?>
<xs:schema xmlns:xs="http://www.w3.org/2001/XMLSchema">
<xs:element name="read_container_stderr">
<xs:complexType>
<xs:attribute name="container" type="xs:string" use="required"/>
<xs:attribute name="n" type="xs:integer" use="optional"/>
</xs:complexType>
</xs:element>
</xs:schema>
```
#### Example
```xml
<read_container_stderr container="interactive-shell" n="1024"/>
```
#### Results
An attribute `actual` is added with the amount of bytes read.
A text node is added with the data as `CDATA`.
### Wait for container to finish
Module: Docker
#### Function declaration
```python
def wait_container(name: str, timeout: int):
"""Wait for a container to finish execution.
Args:
name: Name of the container to wait for
timeout: Time to wait in milliseconds
"""
pass
```
#### Schema
```xml
<?xml version="1.0" encoding="UTF-8"?>
<xs:schema xmlns:xs="http://www.w3.org/2001/XMLSchema">
<xs:element name="wait_container">
<xs:complexType>
<xs:simpleContent>
<xs:extension base="xs:string">
<xs:attribute name="timeout" type="xs:integer" use="required"/>
</xs:extension>
</xs:simpleContent>
</xs:complexType>
</xs:element>
</xs:schema>
```
#### Example
```xml
<wait_container timeout="5000">background-task</wait_container>
```
#### Results
The exit status is added as an attribute.
All remaining data on stdout and stderr is merged and added as `CDATA` text node.
### Select LLM by file name
Module: Reinforcement Learning
#### Function declaration
```python
def select_llm(path: str) -> None:
"""Switch to a different LLM model file.
Args:
path: Path to the model file to load
"""
pass
```
#### Schema
```xml
<?xml version="1.0" encoding="UTF-8"?>
<xs:schema xmlns:xs="http://www.w3.org/2001/XMLSchema">
<xs:element name="select_llm">
<xs:complexType>
<xs:simpleContent>
<xs:extension base="xs:string"/>
</xs:simpleContent>
</xs:complexType>
</xs:element>
</xs:schema>
```
#### Example
```xml
<select_llm>/models/2024_10_19_15_03_52</select_llm>
```
#### Results
No information is added.
The new model will be used starting from the next iteration.
### Update to commit id
Module: Process
#### Function declaration
```python
def update_to_commit(commit_id: str) -> None:
"""Update the running SIA process to a different version.
This will terminate the current process immediately.
Make sure the git commit is well tested and there is plenty of clear documentation for the new SIA instance to start.
Args:
commit_id: The git commit ID to update to
"""
pass
```
#### Schema
```xml
<?xml version="1.0" encoding="UTF-8"?>
<xs:schema xmlns:xs="http://www.w3.org/2001/XMLSchema">
<xs:element name="update_to_commit">
<xs:complexType>
<xs:simpleContent>
<xs:extension base="xs:string"/>
</xs:simpleContent>
</xs:complexType>
</xs:element>
</xs:schema>
```
#### Example
```xml
<update_to_commit>0015e27</update_to_commit>
```
#### Results
No information is added.
The process will be replaced by the new version.
## Example iterations ## Example iterations
### Clarifying a task ### Clarifying a task
This example shows how to work with standard IO, run simple scripts and monitor files. This example shows how to work with standard IO, run simple scripts and monitor files.
#### Context #### Context
```xml ```xml
<context> <context>
<system <system
@@ -248,38 +854,45 @@ This example shows how to work with standard IO, run simple scripts and monitor
</reasoning> </reasoning>
<actions> <actions>
<read_stdin n="42"> <read_stdin n="42">
Remind me to feed the cat tomorrow morning <![CDATA[Remind me to feed the cat tomorrow morning]]>
</read_stdin> </read_stdin>
</actions> </actions>
</previous> </previous>
<files> <files>
<file name="/" type="dir" index="0"> <file name="/" type="dir" index="0">
<![CDATA[
drwxr-xr-x 1 sia 197121 0 2024-10-16 23:02:16.486152500 +0200 tasks/ drwxr-xr-x 1 sia 197121 0 2024-10-16 23:02:16.486152500 +0200 tasks/
drwxr-xr-x 1 sia 197121 0 2024-10-16 22:35:31.806079500 +0200 user/ drwxr-xr-x 1 sia 197121 0 2024-10-16 22:35:31.806079500 +0200 user/
]]>
</file> </file>
<file name="/tasks" type="dir" index="1"> <file name="/tasks" type="dir" index="1">
</file> </file>
<file name="/user" type="dir"> <file name="/user" type="dir">
<![CDATA[
-rw-r--r-- 1 sia 197121 71 2024-10-16 22:41:23.223580300 +0200 general_info.txt -rw-r--r-- 1 sia 197121 71 2024-10-16 22:41:23.223580300 +0200 general_info.txt
]]>
</file> </file>
<file name="/user/general_info.txt" type="file" index="2"> <file name="/user/general_info.txt" type="file" index="2">
Name: John (I don&apos;t know his last name) <![CDATA[
Name: John (I don't know his last name)
Location: Somewhere in Belgium Location: Somewhere in Belgium
]]>
</file> </file>
</files> </files>
</context> </context>
``` ```
#### LLM response #### LLM response
```xml ```xml
John did not specify an exact time. I'll suggest 9am. He also did not specify how to be reminded. I'll ask but if he doesn't respond I'll assume a text message on standard output is fine. I'll write down this task in a file so I can keep it in context. I can write simple files with busybox:latest and echo but I will need to use sh -c to do the redirect. John did not specify an exact time. I'll suggest 9am. He also did not specify how to be reminded. I'll ask but if he doesn't respond I'll assume a text message on standard output is fine. I'll write down this task in a file so I can keep it in context. I can write simple files with busybox:latest and echo but I will need to use sh -c to do the redirect.
<actions> <actions>
<write_stdout message="I'll remind you to feed the cat tomorrow morning at 9am. Is a message on the standard output ok?"/> <write_stdout message="I'll remind you to feed the cat tomorrow morning at 9am. Is a message on the standard output ok?"/>
<start_container image="busybox:latest" timeout="1000" volumes="/tasks:/tasks"> <start_container image="busybox:latest" timeout="1000" volumes="/tasks:/tasks">
<command>sh</command> <command>sh</command>
<parameter>-c</parameter> <argtument>-c</argument>
<parameter><![CDATA[echo 'Remind John to feed the cat on 2024-10-18T09:00:00+02:00. Use standard output.' > /tasks/reminder.txt]]></parameter> <argument><![CDATA[echo 'Remind John to feed the cat on 2024-10-18T09:00:00+02:00. Use standard output.' > /tasks/reminder.txt]]></argument>
</start_container> </start_container>
<monitor_file path="/tasks/reminder.txt"/> <monitor_file path="/tasks/reminder.txt"/>
</actions> </actions>
``` ```