Saturday, 14 September 2024

Non-linear Manifolds

 A chicken crossing the road of Multi-Dimensional Reasoning could never answer why, I presume time is the imperative..




Prompt: good evening, what does "non-linear manifolds" mean in an LLM context?

1. Manifolds as the Backbone of LLM Understanding:

Large Language Models (LLMs) organize language data on non-linear manifolds that twist, fold, and curve to capture the complexity of relationships between words and concepts in high-dimensional spaces. This structure is fixed post-training but dynamically navigated during interactions.

2. Fixed Manifolds with Dynamic Responses:

While the manifolds themselves are fixed after training, the LLM’s ability to explore different parts of these manifolds allows it to generate dynamic, context-specific responses to user prompts, creating the impression of adaptability and intelligence.

Read the full article here:

https://www.talkingtoclaude.com/p/non-linear-manifolds


.

Saturday, 7 September 2024

Robot Bricklaying

FBR are based in Western Australia

They design, develop, build and operate dynamically stabilised robots to address global needs.


Read more about them here

Thursday, 18 April 2024

Humanoid Robots at work: where are we ?

A most interesting paper from  Fabrice Noreils from April 8, 2024.

Extract (verbatim)

"A humanoid robot is an extremely complex machine at the intersection of many disciplines such as mechatronics, control algorithms for underactuated dynamic systems, actuators design, energy consumption optimization, autonomous system in terms of perception localization planning and locomotion...

In addition, all algorithms must be carried out by on-board computers in a very constraint footprint.

Finally, the objective is to put these very complex, therefore fragile, machines in a demanding industrial environment to perform at least as well as a human worker within 2 or 3 years?

This is reminiscent of the enthusiasm and certainties of promoters of autonomous vehicles in the 2010s.

The question we can ask ourselves is the following: is this objective realistic or is it achievable not in 2 or 3 years but within 10 years or more? The aim of this document and its main contributions is to provide some hints by covering the following topics:

1. An analysis of 12 companies based on eight criteria described in section 3. Although these criteria are subjective, they have the benefit of being able to distinguish companies based on their maturity and approach to the market;

2. These humanoids are very complex systems facing technological challenges which are discussed in section 4; 3. Operation and maintenance are critical activities specially when humanoids are deployed at scale. This topic is covered in section 5;

4. Pilots are the last step to test the feasibility of a new system before mass deployment. This is an important step to test the maturity of a product and the strategy of the humanoid supplier to address a market. This topic is addressed in section 6."


Read the full paper here

or in the ArXiv experimental html format



Fabrice Noreils undertook his PhD on robotics and Artificial Intelligence at LAAS CNRS, Toulouse France. He was a researcher on task planning and Execution on wheeled exploratory robots and led R&D teams on resources optimization for a LEO constellation of satellites, character animation of small humanoid robots, autonomous navigation of an indoor flying drone and task planning and navigation of a fleet of AMRs in logistics environment. 




Monday, 19 June 2023

Free Prompt Engineering Course

Free Prompt Engineering Course


I started this for myself to expand into images as another creative endeavour vector however I thought then it may be of interest to the humans, so.. https://tokenomics.ie/

In case you missed it the emergence of Artificial Intelligence (AI) / Large Language Models (LLM) is the biggest thing of this century, so far.

Apr 17th am note.
Given a server update in the last 24 hours Tokenomics is not working..
Probably DNS config - We'll fix it tomorrow... it's late now...

Monday, 15 May 2023

Artificial Intelligence Q1 2023

As the AI field hots up I may switch from an annual update to Quarterly although this will still leave you way behind, imho.

Here are some specific events and products related to artificial intelligence that have occurred so far in 2023:

Google Launches New AI-Powered Assistant: In January 2023, Google launched a new AI-powered assistant called "Google Assistant Pro." The new assistant is designed to provide more personalized and contextually relevant responses to user queries.
https://blog.google/technology/ai/bard-google-ai-search-updates/

Microsoft Acquires AI Start-Up: In February 2023, Microsoft announced that it had acquired an AI start-up called "Deep Learning Technologies." The start-up specializes in developing advanced deep learning algorithms for use in a variety of applications.
https://blogs.microsoft.com/blog/2017/01/13/microsoft-acquires-deep-learning-startup-maluuba-ai-pioneer-yoshua-bengio-advisory-role/

NVIDIA Announces New AI Hardware: In April 2023, NVIDIA announced a new set of hardware designed specifically for AI applications. The hardware, called the "NVIDIA AI Data Center," is designed to provide increased performance and efficiency for AI workloads.
https://nvidianews.nvidia.com/news/nvidia-announces-new-system-for-accelerated-quantum-classical-computing

GPT-4 is the largest and most powerful language model in existence, setting a new benchmark for natural language processing. is in the tech papers. Previously token size was 2048 tokens, now it is 8,192; a 4x increase in size. (most likely subject to pro plans or other variations)
expert reaction to OpenAI announcing GPT-4 - 
https://www.sciencemediacentre.org/expert-reaction-to-openai-announcing-gpt-4/

These are just a few examples of specific events and products related to artificial intelligence that have occurred so far in 2023. As the year progresses we will see even more exciting developments in this rapidly evolving field.. imho. 

As interest grows exponentially I am finding that one must subscribe to some form of paid model to really use / experiment. In most cases paid plans appear to provide:

  • priority access
  • advanced features
  • higher output in words / images / tokens
  • higher input via pdf or other modalities

I compare this with music / concerts, if you really like a band then go / pay.

Matt Wolfe

I'd suggest that you check out Matt Wolfe on Y/T et al. He is doing some seriously heavy lifting in terms of keeping all of us up to date with what is going on.

Thanks Matt..  find him via the links below.

https://www.youtube.com/@mreflow
https://www.futuretools.io/
https://twitter.com/mreflow
https://www.mattwolfe.com/