How SingularityNET is Advancing Unsupervised Language Learning

airesearchlab

#1

This is the first technical post in our new AI Research Lab publication where we will be chronicling the work of SingularityNET’s AI Team. The SingularityNET Research Lab will give you insider access to the most exciting AI initiatives we have under development. When launched, these services will only be available through the SingularityNET platform.

Bridging the Gap: Allowing AI Services to Comprehend & Interact in Human Language

For many AI services, it is critical to be able to comprehend human language and even converse in it with human users. So far, advances in natural language processing (NLP) powered with “sub-symbolic” machine learning based on deep neural networks allows us to solve multiple tasks like machine translation, classification, and emotion recognition.

However, using these approaches requires enormous amount of training. Additionally, there are increasing legal restrictions in particular applications due to recent regulations, making current solutions unviable.

The ultimate goal for these industry initiatives is to allow humans and AI to interact fluently in a common language.

Read Anton’s full post below for more:


#2

I thought a data subject became a data object by simply removing the top layer, name, rank and serial number so to speak… Is that not satisfying the right to be forgotten whilst still making ml curated data available for ai? The use of blockchain would keep the process trustless…


#3

Neat. I’m not smart so I’ll stop at that. Lol.


#4

Testing a position Danny, based on regulatory definitions used in the EU data privacy legislation that is being proposed…


#5

Unsure how this relates to the topic. Though on the subject you mention the idea of stripping pii and hoping others won’t infer using broader data is naive. Example: If a social network bought anonimised data from a hospital but used their own location data to make linkage to a subject with credible certainty. Object and subject data distinction may well be outdated, though I find gdpr an impressive effort


#6

Am I right in thinking that Unsupervised Learning still requires some human input to identify the classes (rather than each instance) ?

I’m trying to figure out how my project, which uses humans to annotate data, can still be relevant when using Unsupervised Learning. At the moment we label/tag everything.

Thanks.


#7

Thank you Matthew for responding to my naive and irrelevant comments


#8

Hey AndyMicrowork - if you’re annotating your data using humans then it’s generally still considered supervised learning. However, there is a lot of interest in various areas of machine learning where people train unsupervised or weakly-supervised for 90% of the problem, and on huge amounts of data, but then fine tune the model on a smaller set of labelled data.


#9

Thanks Joel, thats actually really logical!

I know its an almost impossible question, but can you give me an idea of how big “a smaller set of labelled data” might be for some typical problems?


#10

@Joel and @AndyMicrowork I am a novice in the terms and application of ULL.

In my area of expertise. The energy sector. We utilize specific language to express financial and technical performance.

I recently wrote an article “So WTF is Settlement Quality AI Data (SQAID) for microgrids?!” related to the deregulation of electricity in California.

In energy deregulation, our number one obstacle was leveraging revenue/investment grade data from desparate nodes/agents to sustain the vision of the collective industry. Literally, in the beginning things changed on a daily basis.

We used a term “Settlement Quality Meter Data” to describe the data set that shall be sent to authorities having jurisdiction (shall is purposefully used to emphasize the need to adhere to policy and standard).

In my crude comparison of industry, I coined the term "SQUAID" for the lack of a better term. Settlement Quality AI Data (SQAID). Please don’t attack me here…lol!

Is there a term for various “settlement” quality AI data other than contract?! Is there a Glossary of Terms that a novice might use to be on the same page with SingularityNET?!

For instance, what do you call an “AI perpetuated upgrade algorithm” that will circumvent the need for any future for human intervention. A “machine learning patch”?!

I’d like to learn. I’d like to contribute to the community.


#11

Re: For instance, what do you call an “AI perpetuated upgrade algorithm” that will circumvent the need for any future for human intervention. A “machine learning patch”?!

We call it “incremental learning”, if I get your situation right.

For the rest of “learnings”, there could be different forms, overlapping in practical cases/solutions:

  1. supervised - learning labeled/tagged corpora or having “grounding” annotation supplied to each

  2. reinforcement - when you use unlabeled/untagged corpora or unannotated inputs but every output is supplied with reinforcing feedback so the learner adapts

  3. unsupervised - when you have neither tags/labels nor grounding annotations nor reinforcing feedback

With unsupervised option, you still may have couple relaxations:

a) use unlabeled/untagged yet “controlled” corpora, so the contents of the corpora are prepared by instructor in order with some idea how the learning process should take place (like you give school-level books to children before you you give university-level books to them)

b) use self-reinforcing learning in “reinforcing” environment, where the learner can follow “try-and-fail” approach and self-reinforce themselves in respect to some goal

Goal posing for the latter is another can of worms…


#12

Oh dear, I didn’t explain myself very well. It’s not your comment that I found naive Joe, but the concept that by removing some data items that humans might recognize that the data is suddenly anonymous. It’s a concept that is used in a lot of privacy standards, etc. but for my money is risky. Apologies if that came across wrongly.


#13

No worries Matthew, I’m a bit of a stranger in a strange land…


#14

So you are adding Unsupervised Learning model to NLP to develop ULL(Unsupervised language learning). Is this technique unique to SingularityNET ?

I am under assumption that opencog, itself, is kind of built upon unsupervised model so that it can provide framework to spawn general intelligence. If this is the case then why do we need a separate model to develop ULL ?
May be this vague equation may clear what I want to say:
NLP + Unsupervised Learning model -> ULL (This is described in the article)
NLP + opencog -> ULL (Why not this ?)


#15

OpenCog is umbrella project for almost 40 different sub-projects and provides suite of tools for building AGI: https://github.com/opencog

SingularityNET is umbrella project for almost 20 different sub-projects and provides suite of tools to create decentralised AGI: https://github.com/singnet

ULL is sub-project under both umbrellas and it serves particular goal - enable learning NLP models for any projects in both.
In turn, ULL depends on the core framework in OpenCog https://github.com/opencog/opencog and its parsing tool https://github.com/opencog/link-grammar

NLP is wide domain which includes large part of universe, and the ULL is part of universe called NLP, it is also part of smaller universe called “OpenCog NLP”

That is, if you want magic formula, then:
ULL = OpenCog Framework + OpenCog Link Grammar + SingluarityNet Language Leanring



@cassio and @bengoertzel may correct me if I am missing part of the larger story :slight_smile:


#16

Thanks Anton for the magic formula! I can see now ULL is unique to SingularityNET :+1: