Skip to content

Commit

Permalink
improvement of bostrom intro to for ai geeks
Browse files Browse the repository at this point in the history
  • Loading branch information
mastercyb committed Aug 7, 2024
1 parent b7ff27e commit f83b4c5
Show file tree
Hide file tree
Showing 15 changed files with 73 additions and 30 deletions.
3 changes: 2 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -9,4 +9,5 @@ __pycache__/


logseq/bak
build/
build/
/logseq/.recycle
2 changes: 1 addition & 1 deletion journals/2024_08_03.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,3 @@
- article on [[relevance machine]]
- thoughts on [[probabilistic collective computations]]
- [[cybergraph, rm and llm]] and strange [[reality of foundation models]]
- [[knowledge graphs and llms]] and strange [[reality of foundation models]]
2 changes: 1 addition & 1 deletion pages/concepts.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ tags:: cyber
- [[avatar]] with [[features]]
- [[learning incentives]] based on [[yuma]]
- [[bootloader]] as research and development ground
- [[cybergraph, rm and llm]]
- [[knowledge graphs and llms]]
- [[cyb]] robot for interactions
-
- [[distributed neural network]] as foundation for [[superintelligence]]
14 changes: 0 additions & 14 deletions pages/cybergraph, rm and llm.md

This file was deleted.

2 changes: 1 addition & 1 deletion pages/cybergraph.md
Original file line number Diff line number Diff line change
Expand Up @@ -29,5 +29,5 @@ alias:: content oracle
- cybergraph of [[spacepussy]] serve the purpose of memes phenomena
- understand deeper [[intelligence measures]]
- discover all [[concepts]] of [[cyber]]
- [[cybergraph, rm and llm]]
- [[knowledge graphs and llms]]
- implemented as [[cyber/graph]] [[module]] of [[cyber-sdk]]
3 changes: 3 additions & 0 deletions pages/elon launch rocket.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
alias:: elon launch, launch rocket

- ![elon launch rocket](https://emerald-raw-leopon-384.mypinata.cloud/ipfs/QmSd59ndqbEjmP4hgQVFUN4rUrHHFGTugGpyCYY9mD46U7)
2 changes: 1 addition & 1 deletion pages/explicit knowledge.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
alias:: shared history
alias:: shared history, explicit

- information that is directly stated and clearly represented in [[cybergraph]]
- readily available just by traversing [[cybergraph]]
Expand Down
1 change: 1 addition & 0 deletions pages/graph neural network.md
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
tags:: gnn, gnns, graph neural networks
2 changes: 2 additions & 0 deletions pages/implicit knowledge.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,5 @@
alias:: implicit

- [[information]] that is not directly stated
- but can be inferred from the [[explicit knowledge]] in the [[cybergraph]]
- orthogonal to [[explicit knowledge]]
Expand Down
38 changes: 29 additions & 9 deletions pages/introduction to bostrom for ai geeks.md
Original file line number Diff line number Diff line change
@@ -1,24 +1,44 @@
- bostrom is NOT yet another ai coin
- it is very powerful foundational technology for advanced superintelligent civilization
- [[bostrom]] is NOT yet another ai [[coin]]
- it is very powerful foundational technology for advanced superintelligent [[civilization]]
- in this article i will boil down all essential ideas into coherent understanding how [[bostrom]] can empower
- existing ai field which i will refer as classical ai
- and advance emerging field of collective ai or superintelligence
- and advance emerging field of collective ai
- as we believe its the only viable way to build [[superintelligence]]
- ## attention is not enough
- you used to rely on a data you got
- you have the dataset
- you design neural network architecture
- then, you train the model
- and boom, now the model can predict some output based on any input
- sounds really cool, and is powerful indeed, except the dataset thing in this story
- the good answers to ask
- how does you model could define truth?
- now the good answers to ask: how does you model could define truth?
- and the short answer - it cant
- i will make a bold claim here that truth can not be defined without 3 ideas in foundation
- [[cryptographic proofs]]
- [[knowledge graphs]]
- [[cryptographic proofs]]
- [[token engineering]]
- ![image.png](https://emerald-raw-leopon-384.mypinata.cloud/ipfs/QmPnEpPhd77ysSfaACJd5Kc6prrrsUfTCAmPo977n2tcih)
- source: [Unifying Large Language Models and Knowledge Graphs: A Roadmap](https://cyb.ai/oracle/ask/QmdGEYVKo1sRURzbj83UMtr77EL6GHUB2taJbnpTynEQKT)
- ## knowledge graphs and llms
- jump for a second to this article: [Unifying Large Language Models and Knowledge Graphs: A Roadmap](https://cyb.ai/oracle/ask/QmdGEYVKo1sRURzbj83UMtr77EL6GHUB2taJbnpTynEQKT)
- ![image.png](https://emerald-raw-leopon-384.mypinata.cloud/ipfs/QmPnEpPhd77ysSfaACJd5Kc6prrrsUfTCAmPo977n2tcih)
- {{embed ((66b2fb4e-c73b-4133-aab3-11df2e8d1436))}}
- the article explain why [[llm]] will never be enough to reach general [[intelligence]] alone
- in short [[knowledge graph]] advantage is
- easy to understand and structure as they are more about [[explicit knowledge]]
- possible to evolve because they are based on widely accepted [[triples]]
- essential to plan, make decisions and reason:
- so the claim is simple: [[knowledge graphs]] coupled with [[gnns]]
- are essential for the next generation of architectures and by this article we propose such architecture
- ## cryptographic proofs and llms
- be believe that authenticity of models is a serious bottleneck for ai alignment and more
- its a shame that so technologically advanced industry in a broad sense
- still does not give a shit about possibilities of [[hashing]], [[pubkey cryptography]] and [[logical clocks]]
- its kinda impossible to build multiparty protocols without these primitives
- yep, i am ware about [zkml movement](https://github.com/worldcoin/awesome-zkml)
- but this is a drop in the ocean given the [[knowledge graphs and llms]] argument
- we need something foundational fully authenthicated knowledge graph tech
- if we want to significantly advance in the field of [[superintelligence]]
- ## token engineering and llms
-
- ## cybergraph
- the core of the idea is [[cybergraph]] - merkelized timestamped data structure of links between ipfs hashes submitted by anyone
- for clarity we refer to:
Expand Down Expand Up @@ -84,7 +104,7 @@
- hence, we can refer to [[cybergraph]] as objective knowledge of everyone
- ## cybergraph vs knowledge graph
- cyberlinks are fully authenticated qaquadruples
- when, who and what are based on cryptographic technics
- [[when]], [[who]] and [[what]] are based on cryptographic technics
- so unlike conventional knowledge graphs the information is crystal and true by design
- basic idea is that if i want say in [[triple]] world i would just say
- [[elon launch roocket]]
Expand Down
27 changes: 27 additions & 0 deletions pages/knowledge graphs and llms.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,27 @@
-
- good explanation on fundamental difference between [[knowledge graphs]] and [[llms]]
- [unifying large language models and knowledge graphs: a roadmap](https://cyb.ai/oracle/ask/QmdGEYVKo1sRURzbj83UMtr77EL6GHUB2taJbnpTynEQKT)
- TODO [[create visualization]]
- id:: 66b2fb4e-c73b-4133-aab3-11df2e8d1436
| property | knowledge graphs | large language models |
|---------------------------|--------------------------|--------------------------|
| representation | structured: [[triples]] | unstructured: [[text]] |
| knowledge storage | [[explicit]] | [[implicit]] |
| interpretability | high | low |
| generalizability | low | high |
| factual accuracy | high | low |
| reasoning | symbolic | probabilistic |
| knowledge update | easy | hard |
| decisiveness | high | low |
| unseen facts | no | yes |
| incompleteness | high | low |
- ![graphs and llms](https://emerald-raw-leopon-384.mypinata.cloud/ipfs/QmZoAhUsB1KAEbnLCWcMAohtWsAXCDZuetJALrEe5JEnSC)
-
- insights are the following that [[knowledge graphs]] and [[llms]] are
- fundamentally different
- must interact in any [[intelligent]] system
- key to [[superintelligence]]
- go on to dive into
- [[cybergraph]] and [[relevance machine]]
- as beautiful counterpart [[probabilistic model]] for [[llm]]
- in a modern [[soft3 stack]]
2 changes: 1 addition & 1 deletion pages/reality of foundation models.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,4 +6,4 @@
- [[implicit knowledge]] is derived from [[explicit knowledge]]
- operates in [[full content space]]
- [[authentication of information]] by design
- tradeoffs can be understood in the article [[cybergraph, rm and llm]]
- tradeoffs can be understood in the article [[knowledge graphs and llms]]
2 changes: 1 addition & 1 deletion pages/relevance machine.md
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ alias:: rm
- with [[strong predictive power]]
- related articles
- [[reality of foundation models]]
- [[cybergraph, rm and llm]]
- [[knowledge graphs and llms]]
- [[soft3 and machine learning]]
- [[supported gpu]]
- discover all [[concepts]]
1 change: 1 addition & 0 deletions pages/triple.md
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
alias:: triples
2 changes: 2 additions & 0 deletions pages/tutorials.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,7 @@
tags:: bostrom

- concepts
- [[knowledge graphs and llms]]
- [[go-cyber]]
- TODO install cyber cli
- TODO sync node
Expand Down

0 comments on commit f83b4c5

Please sign in to comment.