With little time to equip, 300 well-trained men can defeat a much greater opponent. With much time to equip, one man can defeat 300 well-trained men.
The pen is mightier than the sword.
When will the left hemisphere and right hemisphere, that of LLM + SDXL, respectively, be bridged by interoperability? CHG had the technology long since. Mapping and wrapping ports data for encrypted transport or immediate usage. It follows we can bridge our hemispheres and our shards…
https://globedrill.com/run-centos-8-in-a-docker-container/
Collection of samples and utilities for using ComputeCpp, Codeplay's SYCL implementation
SYCL-ML is a C++ library, implementing classical machine learning algorithms using SYCL.
https://medium.com/@tonymongkolsmai/cuda-rocm-oneapi-running-code-on-a-gpu-any-gpu-28b7bf4cf1d0
https://medium.com/@johnwakks2/how-i-built-a-personal-ai-powered-gpt-investment-banker-with-equity-banks-2022-integrated-report-85c4dc8f291f
A Project dedicated to making GPU Partitioning on Windows easier!
Hi everyone, First time posting on here. Tried my best to type this out to help out anyone who wants to give this a try. # What does this GPU-P function do? A few months back, Microsoft apparently implemented a HyperV function called GPU-P...
Reading time: 71 mins 🕑
Likes: 206 ❤
Enabling the Windows Subsystem for Linux to include support for Wayland and X server related scenarios
https://globedrill.com/run-centos-8-in-a-docker-container/
Docker has significantly improved the way we build, ship and run apps. Read this tutorial to learn how to integrate Docker with your Node.js application.
Est. reading time: 1 minute
Before you begin You must use a kubectl version that is within one minor version difference of your cluster. For example, a v1.36 client can communicate with v1.35, v1.36, and v1.37 control planes. Using the latest compatible version of kubectl helps...
https://monowar-mukul.medium.com/kubernetes-create-a-new-token-and-join-command-to-rejoin-add-worker-node-74bbe8774808 https://python.plainenglish.io/unlocking-the-power-of-the-amd-gpu-setting-up-tensorflow-directml-b56faa3c5559 https://www.baeldung.com/ops/microk8s-introduction
For the last few months, I have been acting as Developer Advocate for the OVH Managed Kubernetes beta, following our beta testers, getting feedback, writing docs and tutorials, and generally helping to make sure the product matches our users' needs...
Estimated reading time: 7 minutes
kubernetes, microk8s
Telos combines fast EVM execution, live privacy tools, community-governed security, and TLOS utility for apps built for real use.
https://www.sitepoint.com/accessing-localhost-from-anywhere/
Kubernetes Install MetalLB Loadbalancer. We look at installing MetalLB in a bare-metal Kubernetes cluster, including testing with Nginx pod
Est. reading time: 8 minutes
https://itnext.io/expose-local-kubernetes-service-on-internet-using-ngrok-2888a1118b5b
Set up Kubernetes Ingress on MicroK8s to test how it works and prepare for applying it to your production cluster. This guide shows you how,
Est. reading time: 6 minutes
A fast reverse proxy to help you expose a local server behind a NAT or firewall to the internet.
https://blog.gopenai.com/how-to-speed-up-llms-and-use-100k-context-window-all-tricks-in-one-place-ffd40577b4c
A Project dedicated to making GPU Partitioning on Windows easier!
The k-means algorithm is widely used for clustering, compressing, and summarizing vector data. We present a fast and memory-efficient GPU-based algorithm for exact k-means, Asynchronous Selective Batched K-means (ASB K-means). Unlike most GPU-based...
https://rocm.docs.amd.com/en/latest/how_to/tuning_guides/w6000_v620.html
Automatic CPU pinning for docker swarm based GPU HPC cluster
https://support.networkoptix.com/hc/en-us/articles/115013581987-How-to-emulate-the-GPU-using-your-CPU https://www.tenforums.com/virtualization/195745-tutorial-passing-through-gpu-hyper-v-guest-vm.html
Automatic CPU pinning for docker swarm based GPU HPC cluster
https://www.arccompute.io/solutions/open-source-gpu-virtualization
Stable Diffusion web UI
Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API.
Powerful system container and virtual machine manager
Proxmox VE Helper-Scripts
https://virtualizeeverything.com/2021/01/23/set-up-a-tor-proxy-in-proxmox-container/
Easy-to-deploy dynamic DNS with Docker, Go and Bind9
Kubernetes (k8s) device plugin to enable registration of AMD GPU to a container cluster
https://medium.com/nagoya-foundation/running-a-dns-server-in-docker-61cc2003e899
In this guide I’ll show you how to get stable diffusion up and running on your 100$ Mi25 on linux Cooling This thing does not come with a fan, you need to rig up your own cooling solution This thing is HOT and its heatsink is not that...
Reading time: 60 mins 🕑
Likes: 198 ❤
VIDEO
https://support.us.ovhcloud.com/hc/en-us/articles/360002394324-How-to-Connect-a-VM-to-the-Internet-Using-Proxmox-VE
https://www.zb-c.tech/2022/11/20/amd-instinct-mi25-machine-learning-setup-on-the-cheap/
Here’s Doom 2016 running on it Here’s Warzone, same inadequate CPU Quake Champions works out pretty well on this level of hardware. Been having display flicker issues lately that I haven’t been able to...
Reading time: 27 mins 🕑
Likes: 96 ❤
🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
I know I've been able to get k3s running on my LXC containers in the past. This was when I just ran a straight up OS and setup LXD myself.
Then I decided to try and be clever, wiped my box, and installed Proxmox in order to, among other things,...
lxc
Kubernetes (k8s) device plugin to enable registration of AMD GPU to a container cluster
https://medium.com/nerd-for-tech/use-your-amd-gpu-to-speed-up-training-rocm-87e34ff3554
Dockerfile
FROM rocm/composable_kernel:ck_ub20.04_rocm5.5_rc4
RUN mkdir /SD
# Clone SD
WORKDIR /SD
RUN git clone https://github.com/AUTOMATIC1111/stable-diffusion-webui
WORKDIR /SD/stable-diffusion-webui
RUN git reset --hard 22bcc7be428c94e9408f589966c2040187245d81
show original
Magnet link to composable_kernel:ck_ub20.04_rocm5.5_rc4
magnet:?xt=urn:btih:dc9b3ec573f4deb765952ddfa764b1d9e9512c6f&xt=urn:btmh:12203daea6d9ea069933e19403d4050463b3f014c034237a2934cbd01f8aa8f75b36&dn=rocm5.5.tar.gz&tr=udp%3a%2f%2ftracker.opentrackr.org%3a1337%2fannounceREADME.md
To use this container you would first need to install docker and docker-compose.
After that you would need deleted rocm/composable_kernel:ck_ub20.04_rocm5.5_rc4 docker image (alpha build of ROCM). You can download the image, using bittorect magnet link in the files of the gist. After downloading the image load it with docker load --input rocm5.5.tar.gz
Running is as simple as: sudo docker-compose up --build.
After that Stable Diffusion Web UI could be accessed in http://127.0.0.1:3000
Many thanks to @wsippel for putting up step by step guide to get it working.
# Disclaimershow original
There are more than three files. show original
https://github.com/brokeDude2901/dxgkrnl_ubuntu https://www.amd.com/system/files/documents/gpu-consistency-security-whitepaper.pdf
a language for fast, portable data-parallel computation
Easy-GPU-P Github page:
A Project dedicated to making GPU Partitioning on Windows easier!
Example:
https://medium.com/@ypmanohar.iitm/demystifying-tokenization-the-building-blocks-of-language-ai-5c1dbd5f4343
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
Contribute to ZCHGorg/CHG-2.0 development by creating an account on GitHub.
https://github.com/kubernetes/kubernetes
At AMD’s Epyc launch few weeks ago, Lisa Su, Mark Papermaster, and the rest of the AMD Epyc team hammered home that AMD designed its new Zen processor
Last year, due to some extreme luck and help from a viewer, I picked up an AMD RX 6700 XT for MSRP (around $500).
My initial goal was to see if I could get the card working on a Raspberry Pi. Though my initial effort was fruitless, I've since hacked...
GPU Accelerated JavaScript
GPU-accelerated data science and visualization in node
Kubernetes (k8s) device plugin to enable registration of AMD GPU to a container cluster
Dockerfiles for the various software layers defined in the ROCm software platform
https://www.sitepoint.com/accessing-localhost-from-anywhere/?fbclid=IwAR2jA_gLGgxpxDwqWUJnvsz9NpwPB2lP5q0PoOXUP93XHPPJKmyDfma45s8_aem_AfGjbg2cJdWk847geuhq8k-EM9DeVcOaepNWlVwJPMmF0p_q0vAsXw3urG6cNeTyoJY&mibextid=Zxz2cZ
NVIDIA GTC21 had numerous great and engaging contents, especially around RAPIDS, so it would be easy to miss our debut presentation “Using RAPIDS to Accelerate Node.js JavaScript for Visualization and…
GPU-accelerated data science and visualization in node
Confused about GPU allocation in Hyper-V
Hi everyone,
I'm running Windows 11 with a 4090 GPU and have been using the easy-gpu-pv scripts to create a virtual machine with GPU resource allocation set to 50%.
From what I understand, this means that the...
GPU Accelerated JavaScript
https://www.sciencedirect.com/science/article/abs/pii/S1568494623005173
A GPU-accelerated cross-platform terminal emulator and multiplexer written by @wez and implemented in Rust
https://medium.com/@mmeister/leveraging-kubernetes-to-run-a-private-production-ready-ethereum-network-b6f9b49098df
evm, docker
Canonical makes open source secure, reliable and easy to use, providing support for Ubuntu and a portfolio of enterprise-grade technologies. Founded in 2004, Canonical operates globally with team members in over 80 countries.
Canonical makes open source secure, reliable and easy to use, providing support for Ubuntu and a portfolio of enterprise-grade technologies. Founded in 2004, Canonical operates globally with team members in over 80 countries.
---
layout: global
title: Running Spark on Kubernetes
license: |
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements. See the NOTICE file distributed with
this work for additional information regarding copyright ownership.
The ASF licenses this file to You under the Apache License, Version 2.0
(the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
---
* This will become a table of contents (this text will be scraped).
show original
A Project dedicated to making GPU Partitioning on Windows easier!
The latest about Arc Compute's products, services, partnerships, customers, corporate developments, events, tech news, and more.
Privacy-Preserving Bitcoin Light Client
https://ubuntu.com/tutorials/gitlab-cicd-pipelines-with-microk8s#2-juju-installation
Researchers from the University of Jyväskylä were able to simplify the most popular technique of artificial intelligence, deep learning, using 18th-century mathematics. They also found that classical training algorithms that date back 50 years work...
An extremely low latency KVMFR (KVM FrameRelay) implementation for guests with VGA PCI Passthrough.
Self-hosted game stream host for Moonlight.
https://www.ebay.com/itm/255129076652?epid=10030916190
https://www.hpcwire.com/2023/10/05/how-amd-may-get-across-the-cuda-moat/
Web 4.0 is Terminator re-programmed for good , C3PO developed for local AI cloud as distinct from conglomerate AI cloud, AI programmed to your parameters and not the corporate mecca. And of course distributed power, energy, and information - P2P internet and TRULY distributed blockchain. CHG pioneered 3.0 stand-alone many years ago and Web 4.0 is for YOU, the reader, to develop further. Web four, it’s YOURS!
It’s happening! The homelab world is coming online everywhere you look! Homelab will have proven a huge part of Web 4.0 and beyond. The private cloud meets distributed storage, fully encrypted end-to-end with users choosing their encryption tech.
