Termux•5d ago

Alpine Linux & Docker + LLM & MCP

Moving from a #showcase thread To respect their project space @: https://discord.com/channels/641256914684084234/1308059907484028970/1318331169728888894 ... @Willie169 has it & more working: https://discord.com/channels/641256914684084234/1308059907484028970/1318590637733580890

37 Replies

∆•L°gi¢alPeπpl=xit¥OP•5d ago

~~Alright; so, when ./run_qemu.sh it goes to UEFI ... When input to cli Alpine boots.~~ Wait... I've got to get rid of partitions now. . Alpine method 1: https://discord.com/channels/641256914684084234/1308059907484028970/1318360673394233417

∆•L°gi¢alPeπpl=xit¥OP•5d ago

setup-alpine

Alpine3210.md

∆•L°gi¢alPeπpl=xit¥OP•5d ago

sed: /sbin/setup-disk: no such file or directory Is there a Linux Discord I should find, w/out phone verification?

Willie169•5d ago

In line 196

WARNING: Erase the above disk(s) and continue? (y/n) [n]

WARNING: Erase the above disk(s) and continue? (y/n) [n]

y should be chosen, not n. and I didn't do line 197 to 200

alpine3210:~# ifup eth0
alpine3210:~# sed -i -E 's/(local kernel_opts)=.*/\1="console=ttyS0"/' /sbin/set
up-disk
sed: /sbin/setup-disk: No such file or directory

alpine3210:~# ifup eth0
alpine3210:~# sed -i -E 's/(local kernel_opts)=.*/\1="console=ttyS0"/' /sbin/set
up-disk
sed: /sbin/setup-disk: No such file or directory

but it worked correctly so I think those lines are not necessary. Also, I think it's not necessary to use Docker in this case. The performance may be faster if just build the mcp-bridge locally on Termux or a Proot environment without hardware virtualization

∆•L°gi¢alPeπpl=xit¥OP•4d ago

Had to do with ... ? Brb Back w/ edit: to enable serial console on boot Was considering other libraries like gFortran for merged projects. Having ... scipy, opencv-headless ... something else issues. https://discord.com/channels/641256914684084234/1318309351647084666 is one. - Also; thought it had cargo.toml manifest issue iirc? + Yes; .rs Ok gotcha; I was in quandary regarding that when i got mixed results. Where can I read about it; as, otherwise it's running in RAM? Why delete? That's something I thought I got wrong and it worked; then I tried data instead of sys & both as lvm w/ [no] ... Is that space created as a sandbox during the setup? Oh, I just looked closer! It's you! 🙂 Also QDrant https://discord.com/channels/907569970500743200/1289187259878477824

Disk & Install
----------------
Available disks are:
  sda   (2.1 GB ATA      QEMU HARDDISK   )

Which disk(s) would you like to use? (or '?' for help or 'none') [none]
Enter where to store configs ('floppy', 'usb' or 'none') [none]
Enter apk cache directory (or '?' or 'none') [/var/cache/apk]
alpine3210:~#

Disk & Install
----------------
Available disks are:
  sda   (2.1 GB ATA      QEMU HARDDISK   )

Which disk(s) would you like to use? (or '?' for help or 'none') [none]
Enter where to store configs ('floppy', 'usb' or 'none') [none]
Enter apk cache directory (or '?' or 'none') [/var/cache/apk]
alpine3210:~#

It exited prior to [no] https://discord.com/channels/641256914684084234/1318641801900462141/1318734248378630225

Willie169•4d ago

I chose sda and then sys, but I don't know what those options mean. I think lvmdata isn't an option, either lvm or data is

∆•L°gi¢alPeπpl=xit¥OP•4d ago

lvmsys & lvmdata are both options. It'll prompt again if lvm is selected or can combine the first time.

Willie169•4d ago

Oh, thanks.

∆•L°gi¢alPeπpl=xit¥OP•4d ago

It's still UEFI when removing -cdrom Alpine: Step 11: worked

sed -i -E 's/(local kernel_opts)=.*/\1="console=ttyS0"/' /sbin/setup-disk

sed -i -E 's/(local kernel_opts)=.*/\1="console=ttyS0"/' /sbin/setup-disk

From Termux: Step 7: works-1st

qemu-system-x86_64 -machine q35 -m 1024 -smp cpus=2 -cpu qemu64 -drive if=pflash,format=raw,read-only=on,file=$PREFIX/share/qemu/edk2-x86_64-code.fd -netdev user,id=n1,dns=8.8.8.8,hostfwd=tcp::2222-:22 -device virtio-net,netdev=n1 -cdrom alpine-virt-3.21.0-x86_64.iso -nographic alpine3210.img

qemu-system-x86_64 -machine q35 -m 1024 -smp cpus=2 -cpu qemu64 -drive if=pflash,format=raw,read-only=on,file=$PREFIX/share/qemu/edk2-x86_64-code.fd -netdev user,id=n1,dns=8.8.8.8,hostfwd=tcp::2222-:22 -device virtio-net,netdev=n1 -cdrom alpine-virt-3.21.0-x86_64.iso -nographic alpine3210.img

vs Fails @ step 14:

qemu-system-x86_64 -machine q35 -m 1024 -smp cpus=2 -cpu qemu64 -drive if=pflash,format=raw,read-only=on,file=$PREFIX/share/qemu/edk2-x86_64-code.fd -netdev user,id=n1,dns=8.8.8.8,hostfwd=tcp::2222-:22 -device virtio-net,netdev=n1 -nographic alpine3210.img

qemu-system-x86_64 -machine q35 -m 1024 -smp cpus=2 -cpu qemu64 -drive if=pflash,format=raw,read-only=on,file=$PREFIX/share/qemu/edk2-x86_64-code.fd -netdev user,id=n1,dns=8.8.8.8,hostfwd=tcp::2222-:22 -device virtio-net,netdev=n1 -nographic alpine3210.img

From cmd ... Not just the ./run_qemu3210.sh:

#!/bin/bash
qemu-system-x86_64 -machine q35 -m 1024 -smp cpus=2 -cpu qemu64 -drive if=pflash,format=raw,read-only=on,file=$PREFIX/share/qemu/edk2-x86_64-code.fd -netdev user,id=n1,dns=8.8.8.8,hostfwd=tcp::2222-:22 -device virtio-net,netdev=n1 -nographic alpine3210.img

#!/bin/bash
qemu-system-x86_64 -machine q35 -m 1024 -smp cpus=2 -cpu qemu64 -drive if=pflash,format=raw,read-only=on,file=$PREFIX/share/qemu/edk2-x86_64-code.fd -netdev user,id=n1,dns=8.8.8.8,hostfwd=tcp::2222-:22 -device virtio-net,netdev=n1 -nographic alpine3210.img

Last two get UEFI boot https://discord.com/channels/641256914684084234/1318641801900462141/1318797829598085120 this + [Y] delete Those several attempts seem to have eaten several GB ... Gotta figure partition mgmt in UEFI ??... That's been a while .. I was keeping watch on it; then... About 1/4 my total storage used now. Ooof ... UEFI booted to Alpine this time .. huh . Nice!!! Still gotta recover storage partitions. Y no docker?

BdsDxe: loading Boot0001 "UEFI QEMU HARDDISK QM00001 " from PciRoot(0x0)/Pci(0x1F,0x2)/Sata(0x0,0xFFFF,0x0)
BdsDxe: starting Boot0001 "UEFI QEMU HARDDISK QM00001 " from PciRoot(0x0)/Pci(0x1F,0x2)/Sata(0x0,0xFFFF,0x0)

Welcome to Alpine Linux 3.20
Kernel 6.6.66-0-virt on an x86_64 (/dev/ttyS0)

alpine3210 login: root
Password:
Welcome to Alpine!

The Alpine Wiki contains a large amount of how-to guides and general
information about administrating Alpine systems.
See <https://wiki.alpinelinux.org/>.

You can setup the system with the command: setup-alpine

You may change this message by editing /etc/motd.

alpine3210:~# ifup eth0                                                        alpine3210:~#
alpine3210:~# echo "nameserver 8.8.8.8" > /etc/resolv.conf
alpine3210:~# echo "nameserver 8.8.4.4" >> /etc/resolv.conf
alpine3210:~#
alpine3210:~# apk update && apk add docker
fetch http://mirrors.ocf.berkeley.edu/alpine/v3.20/main/x86_64/APKINDEX.tar.gz
v3.20.3-426-g7be77342ca9 [http://mirrors.ocf.berkeley.edu/alpine/v3.20/main]
OK: 5525 distinct packages available
ERROR: unable to select packages:
  docker (no such package):
    required by: world[docker]
alpine3210:~#

BdsDxe: loading Boot0001 "UEFI QEMU HARDDISK QM00001 " from PciRoot(0x0)/Pci(0x1F,0x2)/Sata(0x0,0xFFFF,0x0)
BdsDxe: starting Boot0001 "UEFI QEMU HARDDISK QM00001 " from PciRoot(0x0)/Pci(0x1F,0x2)/Sata(0x0,0xFFFF,0x0)

Welcome to Alpine Linux 3.20
Kernel 6.6.66-0-virt on an x86_64 (/dev/ttyS0)

alpine3210 login: root
Password:
Welcome to Alpine!

The Alpine Wiki contains a large amount of how-to guides and general
information about administrating Alpine systems.
See <https://wiki.alpinelinux.org/>.

You can setup the system with the command: setup-alpine

You may change this message by editing /etc/motd.

alpine3210:~# ifup eth0                                                        alpine3210:~#
alpine3210:~# echo "nameserver 8.8.8.8" > /etc/resolv.conf
alpine3210:~# echo "nameserver 8.8.4.4" >> /etc/resolv.conf
alpine3210:~#
alpine3210:~# apk update && apk add docker
fetch http://mirrors.ocf.berkeley.edu/alpine/v3.20/main/x86_64/APKINDEX.tar.gz
v3.20.3-426-g7be77342ca9 [http://mirrors.ocf.berkeley.edu/alpine/v3.20/main]
OK: 5525 distinct packages available
ERROR: unable to select packages:
  docker (no such package):
    required by: world[docker]
alpine3210:~#

Hrmmm updated ... What's the other command... Searching.

setup-apkrepos -cf

setup-apkrepos -cf

Docker found... Hmmm so close:

alpine3210:~# service docker start
 * /var/log/docker.log: creating file
 * /var/log/docker.log: correcting owner
 * Starting Docker Daemon ...
 [ ok ]
alpine3210:~# rc-update add docker
 * service docker added to runlevel default
alpine3210:~# docker run hello-world
docker: error during connect: Head "http://%2Fvar%2Frun%2Fdocker.sock/_ping": read unix @->/var/run/docker.sock: read: connection reset by peer.
See 'docker run --help'.
alpine3210:~#

alpine3210:~# service docker start
 * /var/log/docker.log: creating file
 * /var/log/docker.log: correcting owner
 * Starting Docker Daemon ...
 [ ok ]
alpine3210:~# rc-update add docker
 * service docker added to runlevel default
alpine3210:~# docker run hello-world
docker: error during connect: Head "http://%2Fvar%2Frun%2Fdocker.sock/_ping": read unix @->/var/run/docker.sock: read: connection reset by peer.
See 'docker run --help'.
alpine3210:~#

Maybe considering openrc .. checking relevancy. ... Simply, ran it again? Hello World works! You're right... That repo got updated .. no longer only docker.

Willie169•3d ago

Congrats. What repo? SecretiveShell/MCP-Bridge or qpd-v/mcp-ragdocs? Btw, my PR fixing MCP-Bridge's typos is merged I guess it may run quicker if locally built in Termux:

git clone https://github.com/SecretiveShell/MCP-Bridge.git
cd MCP-Bridge
echo '{"inference_server":{"base_url":"https://api.openai.com","api_key":"$OPENAI_API_KEY"},"mcp_servers":{"fetch":{"command":"uvx","args":["mcp-server-fetch"]}}}' >> config.json
python3 -m venv .venv
source .venv/bin/activate
pip install -r requirements.txt
python mcp_bridge/main.py

git clone https://github.com/SecretiveShell/MCP-Bridge.git
cd MCP-Bridge
echo '{"inference_server":{"base_url":"https://api.openai.com","api_key":"$OPENAI_API_KEY"},"mcp_servers":{"fetch":{"command":"uvx","args":["mcp-server-fetch"]}}}' >> config.json
python3 -m venv .venv
source .venv/bin/activate
pip install -r requirements.txt
python mcp_bridge/main.py

It failed

Willie169•3d ago

mcp.log

∆•L°gi¢alPeπpl=xit¥OP•3d ago

Hrrmm.. I'm working on {finding a way to get a system going} MCP-BRIDGE, MCP-CLI, MCP-CLIENT ... + OpenWebUi fails ... Another client recommended. . Testing Bridge again (got one working the last day or so)[then had to sleep!] Different error... I got something regarding pydantic-core iirc ... Then, Got it going on localhost tho. Now a similar error to your logs regarding config BaseSettings ... Joined the LMOS disco... Thinking. https://discord.com/channels/1293290789455007804/1293328434986090598/1318878466229141545 Right pydantic-core fix there From: @ badbummer "

git clone https://github.com/LMOS-IO/LMOS-openai-types.git
git switch pydantic-gen

git clone https://github.com/LMOS-IO/LMOS-openai-types.git
git switch pydantic-gen

then build" try uv pip install "lmos-openai-types @ git+https://github.com/LMOS-IO/LMOS-openai-types@pydantic-gen#" Okay; working again. ... Pfff nvm lxml fail ... {Again?}

Willie169•2d ago

What is lxml? I'll try LMOS after college entrance exam cuz I'm way too busy recently.

∆•L°gi¢alPeπpl=xit¥OP•2d ago

LMOS is in the MCP-BRIDGE. lmxl some dependency; got it, now it crashes every time the server finishes loading... . Huh; 1 good run... Then error on dependency, then crash. Hmmm. Sent a DM w/ references to other sources. . Was thinking about languages & syntax of German + Russian when you mentioned a language exam.

Willie169•21h ago

You can speak Germany and Russian? That's amazing. Btw, what I'm gonna take is the GSAT, Taiwanese college entrance exam, of which the subjects are Chinese, English, math, natural science, and social studies, with second level test come after that if one passes the first level criteria of wanted department.

∆•L°gi¢alPeπpl=xit¥OP•20h ago

That's awesome! ... No; bummer, I only know a few words ... Learned some when I was in Germany [cultural immersion = awesome] . I was considering parallels/correlations in those languages to math in linguistic studies; thought it might be interesting to you. It's been proposed; activities like coding implicitly benefit from 1. Native (growing up in the language) versus 2. Learning the language to (some level). Oof ... Ping me; dunno how I missed the response; have the device in my hand this whole time. Checking LibreChat.ai ... There's a thread about install on Alpine in Termux with proot-distro https://discord.com/channels/1086345563026489514/1195033675604185098/1195038076758675607 . End goal is some IDE w/ MCP functions [file access] (+LLM integration like Aider/Cline w/ CEDARScript etc) from a mobile device... Currently, host the broker / server on one and remote with another (2 low capacity devices)

∆•L°gi¢alPeπpl=xit¥OP•20h ago

XML HTML parsing + https://lxml.de

lxml - Processing XML and HTML with Python

lxml - the most feature-rich and easy-to-use library for processing XML and HTML in the Python language

Willie169•17h ago

This plan sounds good to me. I'm planning to learn mb some Japanese and German when as ug as third and fourth language tho my English is still too poor and need more practice

∆•L°gi¢alPeπpl=xit¥OP•17h ago

Doing well so far!

Willie169•17h ago

which channel?

∆•L°gi¢alPeπpl=xit¥OP•17h ago

It's linked.

Willie169•17h ago

found it, thanks

∆•L°gi¢alPeπpl=xit¥OP•17h ago

Device lagged... .. CONSOLIDATION & formatting https://discord.com/channels/641256914684084234/1318641801900462141/1319932668682698794

plan.md
***Considerations:***

**- editor-integration:**
  - Aider.chat [better for smaller edits] -> (GitHub)Ra.aid [aider w/ react loop]
  - Cline [better for larger / more files]
**- model-endpoints:**
  - openRouter 
  +++ etc...
**- MCP's:**
  - filesystem access
  +++
**- system-envs:**
  - Termux <- prefer
   - Alpine Linux
    - Docker
**- UI/ux:**
  - librechat.ai
  - OpenWebUi
  - a python library I found earlier and need to again LoL
  - .wasm / .PWA (too much build w/out template)
  - CLI
*  - IDE:*
   - ACode plugin
   - 
...
My setup:
**2 low capacity Android 13 w/ Termux**
*1. as server/host/broker & UI test
2. Remote access*

plan.md
***Considerations:***

**- editor-integration:**
  - Aider.chat [better for smaller edits] -> (GitHub)Ra.aid [aider w/ react loop]
  - Cline [better for larger / more files]
**- model-endpoints:**
  - openRouter 
  +++ etc...
**- MCP's:**
  - filesystem access
  +++
**- system-envs:**
  - Termux <- prefer
   - Alpine Linux
    - Docker
**- UI/ux:**
  - librechat.ai
  - OpenWebUi
  - a python library I found earlier and need to again LoL
  - .wasm / .PWA (too much build w/out template)
  - CLI
*  - IDE:*
   - ACode plugin
   - 
...
My setup:
**2 low capacity Android 13 w/ Termux**
*1. as server/host/broker & UI test
2. Remote access*

.md format issues Updated. ... Aider keeps failing to build uv, it's already installed. Wondering if proot fixes this and what it'll break (or concerns) https://github.com/streamlit/streamlit It was a different one; still looking. Dunno; aider has a cli https://github.com/CITGuru/PyInquirer

Willie169•16h ago

https://github.com/Aider-AI/aider https://github.com/hyperledger/fabric

∆•L°gi¢alPeπpl=xit¥OP•16h ago

I know (of) hyperledger . Loading fabric pages.

Willie169•16h ago

I think mb you can firstly build things on an QEMU VM cuz proot don't have systemd

∆•L°gi¢alPeπpl=xit¥OP•16h ago

Like the Alpine Qemu VM?

Willie169•16h ago

yup

∆•L°gi¢alPeπpl=xit¥OP•16h ago

Ouch What are your thoughts on hyperledger?

Willie169•16h ago

idk much about it. I has only used it to use LLMs on CLI After succeeded in qemu, systemd-sysv, box64, etc. may can help to migrate to proot. Directly use Termux may be possible. An example is mobox, which is said to succeeded in simulate Windows x86_64 without proot on Termux, but it's close source tho

∆•L°gi¢alPeπpl=xit¥OP•16h ago

Ok. Well; that device, maybe I add a core and maybe the android system still works. .. days avoiding it with workarounds after got it working ... You're right. What'd you use for hyperledger CLI? Going to miss the MCP & file access?

Willie169•16h ago

OpenAI, Antropic, Mistral, Gemini, Openrouter, Siliconflow

∆•L°gi¢alPeπpl=xit¥OP•16h ago

Oic .. you plugged it into fabric-cli

Willie169•16h ago

I think MCP is better but I haven't get used to it

∆•L°gi¢alPeπpl=xit¥OP•16h ago

I can DM some servers invites

Willie169•16h ago

Great, thanks https://github.com/anaisbetts/mcp-installer just come across it, haven't try

∆•L°gi¢alPeπpl=xit¥OP•15h ago

Yeah; it's on my list. There's a project in the MCP server about these. https://GitHub.com/acehoss/mcp-gateway . Ai-christianson/Ra.aid supports: https://discord.com/channels/1316891174149292082/1316891174149292085/1320020795585597540

Gaming

Programming

Alpine Linux & Docker + LLM & MCP