https://joey00072.com/blog Notes on AI, machine learning and Python: building autograd engines from scratch, JAX internals, language-model experiments, and other things I find interesting. en-us 00shxf@gmail.com (Joey00072) 00shxf@gmail.com (Joey00072) Mon, 26 Aug 2024 00:00:00 GMT https://joey00072.com/blog/microjax https://joey00072.com/blog/microjax MicroJax is a minimal implementation of JAX in pure Python. It is a fun project to learn about JAX and how it works under the hood. Mon, 26 Aug 2024 00:00:00 GMT 00shxf@gmail.com (Joey00072) jaxmicrojaxtpupytorchflaxjax from scratch https://joey00072.com/blog/mixture-of-depth-is-vibe https://joey00072.com/blog/mixture-of-depth-is-vibe Thought and code about mixture of depth Thu, 11 Apr 2024 00:00:00 GMT 00shxf@gmail.com (Joey00072) MLGPTlanguage modelmixture of depthpytorchbitnetMoD https://joey00072.com/blog/Experiments-with-Bitnet https://joey00072.com/blog/Experiments-with-Bitnet The blog explores implementing Bitnet 1.5, highlighting its efficiency gains and challenges in quantized neural network training. Sat, 23 Mar 2024 00:00:00 GMT 00shxf@gmail.com (Joey00072) MLGPTlanguage modeltinytorchpytorchbitnet https://joey00072.com/blog/buinging-own-autograd-engine-tinytorch-04 https://joey00072.com/blog/buinging-own-autograd-engine-tinytorch-04 Building my own dl framework name tinytorch, Fri, 29 Sep 2023 00:00:00 GMT 00shxf@gmail.com (Joey00072) autogradMLGPTlanguage modeltinytorchpytorchnumpy https://joey00072.com/blog/buinging-own-autograd-engine-tinytorch-03 https://joey00072.com/blog/buinging-own-autograd-engine-tinytorch-03 Building my own dl framework name tinytorch, Tue, 29 Aug 2023 00:00:00 GMT 00shxf@gmail.com (Joey00072) autogradMLGPTlanguage modeltinytorchpytorchnumpy https://joey00072.com/blog/buinging-own-autograd-engine-tinytorch-02 https://joey00072.com/blog/buinging-own-autograd-engine-tinytorch-02 Building my own dl framework name tinytorch, Mon, 28 Aug 2023 00:00:00 GMT 00shxf@gmail.com (Joey00072) autogradMLGPTlanguage modeltinytorchpytorchnumpy https://joey00072.com/blog/buinging-own-autograd-engine-tinytorch-01 https://joey00072.com/blog/buinging-own-autograd-engine-tinytorch-01 Building my own dl framework name tinytorch, Sun, 27 Aug 2023 00:00:00 GMT 00shxf@gmail.com (Joey00072) autogradMLGPTlanguage modeltinytorchpytorchnumpy https://joey00072.com/blog/running-llama2.c-on-buget-android https://joey00072.com/blog/running-llama2.c-on-buget-android Explore the process of running lama2.c on a budget Android device using Termux. Learn about setup, installation, practical guide. Tue, 25 Jul 2023 00:00:00 GMT 00shxf@gmail.com (Joey00072) LLMMLGPTlanguage modeledgetermuxandroid https://joey00072.com/blog/Conways-Game-of-life-in-python https://joey00072.com/blog/Conways-Game-of-life-in-python Conways Game of life is by far the most famous cellular automato. It is best example of how many simple thing can work thougher to create someting complex. If almost fells like real life Wed, 06 Oct 2021 00:00:00 GMT 00shxf@gmail.com (Joey00072) Game of Lifepythonpygameconvolution https://joey00072.com/blog/how-to-execute-a-program-or-call-a-system-command-from-python https://joey00072.com/blog/how-to-execute-a-program-or-call-a-system-command-from-python Execute call a system command from Python.execute a other program from Python Mon, 28 Jun 2021 00:00:00 GMT 00shxf@gmail.com (Joey00072) ospythonsubprocesssystem https://joey00072.com/blog/read-parse-json-in-python https://joey00072.com/blog/read-parse-json-in-python Read/Parse json in python,Converting json into dictionary. Wed, 23 Jun 2021 00:00:00 GMT 00shxf@gmail.com (Joey00072) jsonpython https://joey00072.com/blog/display-and-change-framerate-in-pygame https://joey00072.com/blog/display-and-change-framerate-in-pygame Easy way to display and change frame rate in pygame Tue, 22 Jun 2021 00:00:00 GMT 00shxf@gmail.com (Joey00072) gamepythonpygamefps https://joey00072.com/blog/read-csv-files-in-python https://joey00072.com/blog/read-csv-files-in-python Easy way to read CSV file in python Mon, 31 May 2021 00:00:00 GMT 00shxf@gmail.com (Joey00072) csvpythonpandasfile https://joey00072.com/blog/fractal-tree-in-python https://joey00072.com/blog/fractal-tree-in-python Fractal Tree in python Fri, 28 May 2021 00:00:00 GMT 00shxf@gmail.com (Joey00072) Fractal Treepythonpygamerecursion https://joey00072.com/blog/Closure-in-Python https://joey00072.com/blog/Closure-in-Python Basic introduction to closures in python. closure are inside function that remembers values of outside function. even when outside functions are over. Fri, 26 Feb 2021 00:00:00 GMT 00shxf@gmail.com (Joey00072) pythonClosure