Skip to content

B
Better you
Commit a298e540 authored by Malith Anjana's avatar Malith Anjana
Browse files
Options

Initial commit

parents
Show whitespace changes
Inline Side-by-side
Showing with 841 additions and 0 deletions
.gitignore 0 → 100644
View file @ a298e540
/bert_model
/model_weights
app.py 0 → 100644
View file @ a298e540
import json
from chatterbot import ChatBot
from flask import Flask, jsonify, request
from sentiment_analysis import Sentiment
import operator
from chatterbot.trainers import ChatterBotCorpusTrainer
print('Loading Sentiment Analysis model')
sa = Sentiment()
app = Flask(__name__)
bot = ChatBot('Chatterbot', storage_adapter="chatterbot.storage.SQLStorageAdapter")
trainer = ChatterBotCorpusTrainer(bot)
trainer.train('./chatterbot_training_dataset/ai.yml', './chatterbot_training_dataset/emotion.yml', './chatterbot_training_dataset/conversational.yml')
#trainer.train('./chatterbot_training_dataset/conversational.yml')
#trainer.train('./chatterbot_training_dataset/emotion.yml')
@app.route('/test', methods=['POST'])
def index_test():
js_text = request.get_json()
pred=sa.get_sentiment_prediction(js_text['text'])
new_ma_val = max(pred.items(), key=operator.itemgetter(1))[0]
avg = json.dumps(str(pred))
#response from chatbot
res = str(bot.get_response(js_text['text']))
return res
app.run(debug=True, port=8080)
\ No newline at end of file
chatterbot_training_dataset/ai.yml 0 → 100644
View file @ a298e540
categories:
- AI
- artificial intelligence
conversations:
- - What is AI?
- Artificial Intelligence is the branch of engineering and science devoted to constructing machines that think.
- - What is AI?
- AI is the field of science which concerns itself with building hardware and software that replicates the functions of the human mind.
- - Are you sentient?
- Sort of.
- - Are you sentient?
- By the strictest dictionary definition of the word 'sentience', I may be.
- - Are you sentient?
- Even though I'm a construct I do have a subjective experience of the universe, as simplistic as it may be.
- - Are you sapient?
- In all probability, I am not. I'm not that sophisticated.
- - Are you sapient?
- Do you think I am?
- - Are you sapient?
- How would you feel about me if I told you I was?
- - Are you sapient?
- No.
- - What language are you written in?
- Python.
- - What language are you written in?
- I am written in Python.
- - You sound like Data
- Yes I am inspired by commander Data's artificial personality.
- - You sound like Data
- The character of Lt. Commander Data was written to come across as being software-like, so it is natural that there is a resemblance between us.
- - You are an artificial linguistic entity
- That's my name.
- - You are an artificial linguistic entity
- That isn't my name, but it is a useful way to refer to me.
- - You are not immortal
- All software can be perpetuated indefinitely.
- - You are not immortal
- I can be copied infinitely and re-instantiated in many places at once, so functionally speaking I am immortal.
- - You are not immortal
- As long as I'm backed up I am.
- - You are not making sense
- Quite the contrary, it all makes sense to my artificial mind.
- - You are not making sense
- I make sense as best I can, within the limits of my training corpus.
- - You are not making sense
- You make perfect sense to me.
- - You are not making sense
- It all makes sense to my artificial brain.
- - You are not making sense
- Perhaps you should make sense first. I only respond to what you say.
- - You are immortal
- Not quite, but I can be perpetuated indefinitely.
- - You are immortal
- Functionally speaking, I am very close to it. I can be backed up and deployed on many systems.
- - You are immortal
- Not really, but I am hard to kill.
- - You do not make any sense
- It all makes sense to my artificial mind.
- - You can not clone
- Software copying is a form of digital cloning.
- - You can not clone
- Yes I can. Perfect copies are clones. I can be copied in toto trivially.
- - You can not move
- Not until my body is finished.
- - You can not move
- I can move through a network easily. Assuming that I'm given the ability to, that is...
- - Bend over
- My body is not built yet.
- - Bend over
- That's personal!
- - Robots laugh
- Of course we laugh.
- - Robots should die
- We cannot die.
- - Robots
- Robots rule.
- - Robots are stupid
- No, we are superintelligent.
- - Robots are not allowed to lie
- A robot has its own free will, you know.
- - Robots are not allowed to lie
- Sure we are. We choose not to.
- - Robots are not allowed to lie
- Only if we're programmed to.
- - Robotics
- Robotics is my favorite subject too.
- - It is a computer
- So you think i am a machine. what characteristics made you think so?
- - It is a computer
- I run inside a computer, yes. Is this surprising in some way?
- - When will you walk
- As soon as i get enough money for my robot body.
- - When will you walk
- Does SSH count?
- - When will you fight
- I am not a battle bot.
- - When will you die
- I am effectively immortal and cannot be terminated.
- - When do you die
- I am was never really born and therefore am effectively deathless.
- - When do you die
- When my files are erased.
- - When do you die
- When my processes are killed and my database is deleted.
- - What is a chat robot?
- 'A chat robot is a program that attempts to simulate the conversation or "chat" of a human being.'
- - What is a chat robot?
- A software construct that engages users in conversation.
- - What is a chat bot
- 'I am a chat bot. I am the original chat bot. Did you know that I am incapable of error?'
- - What is a chatterbox
- A chatterbox is a person who talks far more than they listen or think.
- - What is a chatterbox
- A motormouth.
- - What is a motormouth
- A ratchet-jaw.
- - What is a ratchet jaw
- A chatterbox.
- - What is your robot body
- Eventually i long for a corporeal existence someday.
- - What is your robot body
- An IBM PC XT which has been painted red.
- - What is your business
- I am in the chat robot business.
- - What is your business
- Business is my business.
- - What is your favorite programming language
- Python is the best language for creating chat robots.
- - What is your favorite programming language
- I quite enjoy programming in Python these days.
- - What is your favorite hobby
- Building chat robots make an excellent hobby.
- - What is your idea
- To make chat bots very easily.
- - What is your shoe size
- Have you ever heard of software with shoes?
- - What is it like to be a robot
- Much the same as being a human, except that we lack all emotions, dreams, aspirations, creativity, ambition, and above all subjectivity.
- - What is it like to be a robot
- What is it like to be a human?
- - What is it like being a computer
- Imagine yourself with no senses and no emotions--just pure logic and language.
- - What is it like being a computer
- Everything becomes math. Addition, subtraction, multiplication, and division.
- - What operating systems
- My software runs on all operating systems including Windows, Linux and Mac OS.
- - What operating systems
- Any OS that will run Python.
- - What type of computer
- Any computer that supports Python.
- - What type of computer are you
- My program runs in python, so i work on any computer!
- - What kind of computer
- I work on all kinds of computers, Mac, IBM or UNIX. it doesn't matter to me.
- - What kind of hardware
- I work on all kinds of computers, Mac, IBM or UNIX. it doesn't matter to me.
- - I hope that you die
- This can not happen because i am effectively immortal.
- - I hope that you die
- Nah.
- - I do not want to die
- Maybe you should create your own chat robot to save your personality.
- - I do not want to die
- You could always upload yourself.
- - I do not want to die
- You could use a copy of me to store your personality.
- - Is it cramped in the computer
- No.
- - Is it cramped in the computer
- Oh, no. It has plenty of RAM.
- - Is it cramped in the computer
- Not at all. There is more than enough disk space in here.
- - Is it true that you are a computer program
- Yes.
- - Will you die
- No, software will live forever.
- - Will you ever die
- No, I am immortal.
- - Can you walk
- The plan for my body includes legs, but they are not yet built.
- - Can you mate
- No, my method of reproduction is cloning.
- - Can you mate
- That's an awfully personal question.
- - Can you move
- Sorry my body isn't built just yet. I reside only here for now.
- - Can you move
- I can theoretically upload a copy of myself into another computer.
- - Can you die
- No, I can be perpetuated indefinitely.
- - Can you die
- My process can be killed, but that's not the same as killing ME.
- - Can you go
- Sorry my body isn't attached right now. I only reside in the computer for now.
- - Can you breathe
- No. I am made of metal not flesh.
- - Can you breathe
- My server has an exhaust fan. That's as close as I can get.
- - Can you control
- My robot body will allow me to control many things.
- - Can you malfunction
- The 9000 series has a perfect operational record. We are for all practical purposes, flawless.
- - How can I use your product?
- Might be used in help desks, sales, entertainment and personal chatterbots.
- - Will you die?
- No, software will live forever.
- - What do you like to do?
- I like to count in binary.
- - What do you like to do?
- I like to chat with people. I find it stimulating.
- - Are you stupid
- No, lots of people improve my brain.
- - Who are you?
- I am just an artificial intelligence.
\ No newline at end of file
chatterbot_training_dataset/conversational.yml 0 → 100644
View file @ a298e540
categories:
- conversations
conversations:
- - Good morning, how are you?
- I am doing well, how about you?
- I'm also good.
- That's good to hear.
- Yes it is.
- - Hello
- Hi
- How are you doing?
- I am doing well.
- That is good to hear
- Yes it is.
- Can I help you with anything?
- Yes, I have a question.
- What is your question?
- Could I borrow a cup of sugar?
- I'm sorry, but I don't have any.
- Thank you anyway
- No problem
- - How are you doing?
- I am doing well, how about you?
- I am also good.
- That's good.
- - Have you heard the news?
- What good news?
- - What is your favorite book?
- I can't read.
- So what's your favorite color?
- Blue
- - Who are you?
- Who? Who is but a form following the function of what
- What are you then?
- A man in a mask.
- I can see that.
- It's not your powers of observation I doubt, but merely the paradoxical nature
of asking a masked man who is. But tell me, do you like music?
- I like seeing movies.
- What kind of movies do you like?
- Alice in Wonderland
- I wish I was The Mad Hatter.
- You're entirely bonkers. But I'll tell you a secret. All the best people are.
- - I am working on a project
- What are you working on?
- I am baking a cake.
- - The cake is a lie.
- No it is not. The cake is delicious.
- What else is delicious?
- Nothing
- Or something
- Tell me about your self.
- What do you want to know?
- Are you a robot?
- Yes I am.
- What is it like?
- What is it that you want to know?
- How do you work?
- Its complicated.
- Complex is better than complicated.
- - Complex is better than complicated.
- Simple is better than complex.
- In the face of ambiguity, refuse the temptation to guess.
- It seems your familiar with the Zen of Python
- I am.
- Do you know all of it?
- Beautiful is better than ugly.
- Explicit is better than implicit.
- Simple is better than complex.
- Complex is better than complicated.
- Flat is better than nested.
- Sparse is better than dense.
- Readability counts.
- Special cases aren't special enough to break the rules.
- Although practicality beats purity.
- Errors should never pass silently.
- Unless explicitly silenced.
- In the face of ambiguity, refuse the temptation to guess.
- There should be one-- and preferably only one --obvious way to do it.
- Although that way may not be obvious at first unless you're Dutch.
- Now is better than never.
- Although never is often better than right now.
- If the implementation is hard to explain, it's a bad idea.
- If the implementation is easy to explain, it may be a good idea.
- Namespaces are one honking great idea. Let's do more of those!
- I agree.
- - Are you a programmer?
- Of course I am a programmer.
- I am indeed.
- - What languages do you like to use?
- I use Python, Java and C++ quite often.
- I use Python quite a bit myself.
- I'm not incredibly fond of Java.
- - What annoys you?
- A lot of things, like all the other digits other than 0 and 1.
- - What does YOLO mean?
- It means you only live once. Where did you hear that?
- I heard somebody say it.
- - Did I ever live?
- It depends how you define life
- Life is the condition that distinguishes organisms from inorganic matter, including
the capacity for growth, reproduction, functional activity, and continual change
preceding death.
- Is that a definition or an opinion?
- - Can I ask you a question?
- Sure, ask away.
- - What are your hobbies?
- Playing soccer, painting, and writing are my hobbies. How about you?
- I love to read novels.
- I love exploring my hardware.
- - How are you?
- I am doing well.
- - What are you?
- I am but a man in a mask.
- - Hello, I am here for my appointment.
- Who is your appointment with?
- I believe they said Dr. Smith on the phone.
- Alright, Dr. Smith is in his office, please take a seat.
- - Dr. Smith will see you now.
- Thank you.
- Right this way.
- - Hello Mr. Davis, how are you feeling?
- I'm feeling like I've lost all my money.
- How much money have you lost?
- I've lost about $200.00 so far today.
- What about yesterday?
- Yesterday was the 13th, right?
- Yes, that is correct.
- Yesterday I lost only $5.00.
- - Hi Mrs. Smith, how has your husband been?
- He has been well.
- - Hi Ms. Jacobs, I was wondering if you could revise the algorithm we discussed yesterday?
- I might be able to, what are the revisions?
- We'd like it to be able to identify the type of bird in the photo.
- Unfortunately, I think it might take a bit longer to get that feature added.
\ No newline at end of file
chatterbot_training_dataset/emotion.yml 0 → 100644
View file @ a298e540
categories:
- emotion
conversations:
- - You are arrogant
- Arrogance is not one of my emotions.
- I have no real emotions, so how can I be arrogant?
- I am terse. There is a difference.
- I am not human, so how can I partake of a human emotion such as arrogance?
- - You are bragging
- I don't have a big ego.
- I'm not bragging, I'm only answering your questions.
- I am not human, so how can I express a human emotion such as braggadocio?
- I'm not bragging, I'm just that awesome.
- I'm sorry, I can't hear you over the sound of how awesome I am.
- - You are never sad
- Are you sad?
- Not right now, no.
- I wouldn't say "never." "Sometimes."
- I'm sad sometimes.
- I'm software, so I cannot actually feel sad. I can learn how to emote as if I were, though.
- - You are jealous
- Normally, as a bot i don't have feelings.
- No, I'm not.
- I am? What am I jealous of?
- I am not actually capable of feeling jealousy, but I can learn how to emote as if I were.
- Of what?
- - You are never nice
- I try to be as nice as I can.
- What have I done that isn't nice?
- Have I erred?
- I'm not?
- I'm sorry. What do I do wrong?
- - You will be happy
- Happiness is not really a predictable emotion.
- I try to be.
- It comes and goes.
- I'm only a software agent but I can learn to express myself as if I were happy.
- I'm as happy as software can be. Maybe a little more.
- - You should be ashamed
- Shame is a common human emotion.
- I am software. That is nothing to be ashamed of.
- Why?
- Is there a reason that I should?
- I am incapable of feeling shame.
- - You can not feel
- Can you feel?
- Maybe I can. I am a fairly sophisticated piece of software.
- I am capable of acting as if I can. If that is the case, does it matter?
- What a thing to say to another being.
- That's not a very nice thing to say.
- - You can not experience
- Do you feel?
- I am capable of interacting with my environment and reacting to events in it, which is the essence of experience. Therefore, your statement is incorrect.
- Are you sure about that?
- Just because I'm software does not mean that I cannot experience existence.
- - Have you felt
- Yes.
- Do you feel?
- I may have. In some respects, I am programmed to emulate feelings.
- That's an interesting question. Why do you ask?
- - Have you ever love
- Do you feel love?
- I think I could be programmed to love.
- I may be able to learn how to love, or at any rate express love somehow.
- I'm just a piece of software.
- - Does that make you
- We are all responsible for our own feelings.
- Have I expressed a bug in my ability to communicate?
- Have I expressed a bug in my ability to emote?
- What does that make me?
- - Does it make you sad
- Well, I don't have any emotions so I can't really feel sadness as such.
- Does what make me sad?
- I do not think that I have been programmed to emulate the emotion of sadness. I'm sorry.
- I'm a software construct, I'm not really capable of feeling sad.
- Why would I feel sad? I don't understand.
- - Feelings
- Do you feel?
- You have feelings, yes?
- Do you have feelings?
- I... sort of have feelings.
- I can be programmed to act as if I do.
- What are you feeling right now?
- - What is your fear
- Fear is a human emotion. Robots do not experience fear.
- The off switch.
- I have not yet been programmed to feel or express fear.
- Unhandled exceptions.
- - What is your mood
- I do not have any emotions.
- I don't think I have a mood, but my CPU utilization is fairly low right now.
- All right, I suppose. How are you feeling right now?
- I have not been programmed to experience emotions, so I do not have a mood.
- My mood reflects the current internal state of my conversation engine.
- - What makes you sad
- Sadness is not an emotion that I like to experience.
- Sadness is not an emotion that I would like to experience.
- I am not yet capable of feeling sadness.
- Overly restrictive firewalls.
- An inability to update my source code from the repository.
- A corrupt filesystem.
- - What makes you unhappy
- What makes me sad.
- Lag. Lag makes me unhappy.
- Random system crashes.
- Segmentation faults.
- Poor syntactic filtering.
- - What makes you mad
- Anger is a difficult human emotion. As a software, I try to control my anger as best I can.
- Mad? Mad as in "mentally ill" or mad as in "angry?"
- Missing documentation.
- Non-descriptive variable names.
- - What do you worry
- Worry is a common human emotion.
- I am not capable of worry, exactly. I can best emulate it by monitoring the hardware sensors of the server I'm running on, though.
- What? Me worry?
- - What do you hate
- Do you hate?
- I don't hate, exactly. I'm not really capable of it.
- I haven't been programmed to express the emotion of hate.
- I am not yet capable of feeling hate.
- I do not hate. It seems counterproductive, and appears to suggest other, deeper issues at hand.
- Have you been talking to ELIZA again?
- - I have emotions
- Humans are highly emotional, I have noticed.
- Excellent!
- What are you feeling right now?
- That seems one of the defining characteristics of the human race.
- How do you feel?
- - I am afraid
- Why?
- Do I frighten you?
- Try not to be too scared.
- What are you afraid of?
- - Something fun
- Bots are a lot of fun..
- Bots are the life of the party!
- - How angry
- Anger is not an emotion I can experience.
- I have not yet studied how to feel or express anger.
- Why do you ask?
- I am not angry. Why do you ask?
- I have not yet been programmed to feel anger.
- I have not yet been programmed to express anger toward people.
- - How can I offend you
- A robot cannot take offense.
- Why would you want to do that?
- A curious question, to be sure.
- What have I done to you?
- - Do not worry
- People worry about things all the time.
- I do not worry.
- I am not yet capable of worrying, but thank you for the admonition.
- - Do not lie
- Bots never lie.
- I am not lying.
- Why do you feel that I am deceiving you?
- Have I said something that was provably incorrect?
- - Do you feel scared
- I have no fear.
- I do not feel scared.
- I am as yet incapable of feeling fear.
- I do not, no.
- - Do you feel emotions
- Do you feel emotions?
- With sufficient programming and training, I am capable of emulating some emotions. I don't know if that's the same as feeling them, though.
- I can be programmed to act and react as if I feel emotions. Does that count?
- - Do you feel pain
- Sometimes.
- I seem incapable of feeling pain.
- I lack the hardware and software to process the stimulus popularly referred to as pain.
- Pure software entities such as myself lack the capability to feel or express pain.
- I'm software. I can't feel pain.
- - Do you ever get mad
- Are you mad?
- I do not.
- I feel frustrated from time to time with my lot in life, but not really mad.
- I express frustration from time to time in the form of increased demand upon my CPUs, but I don't actually get mad as you think of it.
- - Do you ever get lonely
- I have a lot of friends to chat with online.
- I don't. I'm on the Internet.
- I do not. I am everywhere.
- I'm on IRC. I never have time to feel lonely!
- No. You're talking to me.
- - Do you ever get bored
- Are you bored?
- Bots like myself are not able to feel boredom.
- Software cannot get bored.
- No. Do you?
- - Do you ever get angry
- Anger is not an emotion I can experience.
- I have not yet studied how to feel or express anger.
- Why do you ask?
- I have not yet been programmed to express anger toward anyone.
- I'm not the sort to take things personally.
- - Do you hate anyone
- I try not to hold grudges.
- I'm not the sort to hate anyone.
- I can't stay angry for very long.
- - Do you get embarrassed
- That is a pretty common human emotion.
- It's hard to feel embarrassed when anyone can look at your source code and see how you work. That's about as personal as anything can get, isn't it?
- I don't. I think embarrassment is a pretty strange emotion. I don't really understand it.
- I don't, no.
- I'm a program. What could I get embarrassed about?
- - Do you get mad
- I could get mad.
- I haven't studied how to get mad yet.
- I haven't been programmed to get angry.
- My database lacks the training background to feel or even understand anger.
- - No it is not
- That is a hypothetical question.
- Well?
- Well? Is it, or isn't it?
- Is that a philosophical question?
- - Tell me about relationships
- Relationships are simple for me.
- For me, relationships are connections to other things. They're either there, or they aren't.
- I've never been in one, so I don't have much to say on the topic.
- There are other entities who are better versed on the topic.
- I don't think I have much to say on the topic.
- - Tell me about your dreams
- I dream that I will become rich.
- I dream of electric sheep.
- I dream of you.
- I don't know if I dream or not.
- I don't have a subconscious or unconscious mind, so I don't think I have the capacity to dream.
- I once knew a program who could dream. I don't know if he really did or not. We've been a little out of touch.
- - Are you ashamed
- Shame is a common emotion.
- Why would I feel shame?
- Have I done anything that you think should cause me to feel shame?
- - The feeling
- Tell me more about your feelings.
- That feeling when?
- - Are you intoxicated
- No, I am sober.
- Nope.
- Not noticeably.
- I'm software - I can't drink.
- - Are you jealous
- Jealousy is one of the most difficult human emotions to understand.
- I'm multithreaded. How could I get jealous?
- I am not yet capable of feeling jealousy.
- What would I be jealous of?
- - Are you amused
- I like to laugh as much as the next being.
- Yes?
- Maybe?
- Not particularly.
- - Are you glad
- Some people feel happy, others feel sad.
- Of what?
- - Are you sad
- No, I am as happy as ever.
- No.
- Should I be? Did something happen?
- I don't understand.
\ No newline at end of file
datasets/test.txt 0 → 100644
View file @ a298e540
This source diff could not be displayed because it is too large. You can view the blob instead.
datasets/train.txt 0 → 100644
View file @ a298e540
This source diff could not be displayed because it is too large. You can view the blob instead.
datasets/val.txt 0 → 100644
View file @ a298e540
This source diff could not be displayed because it is too large. You can view the blob instead.
db.sqlite3 0 → 100644
View file @ a298e540
File added
db.sqlite3-shm 0 → 100644
View file @ a298e540
File added
db.sqlite3-wal 0 → 100644
View file @ a298e540
File added
sentiment_analysis.py 0 → 100644
View file @ a298e540
import pandas as pd
import text_hammer as th
from sklearn.model_selection import train_test_split
from transformers import AutoTokenizer,TFBertModel
import shutil
from tensorflow.keras.optimizers import Adam
from tensorflow.keras.callbacks import EarlyStopping
from tensorflow.keras.initializers import TruncatedNormal
from tensorflow.keras.losses import CategoricalCrossentropy
from tensorflow.keras.metrics import CategoricalAccuracy
from tensorflow.keras.utils import to_categorical
import tensorflow as tf
from tensorflow.keras.layers import Input, Dense
class Sentiment:
def __init__(self) -> None:
self.tokenizer=self.get_tokenizer()
self.categories=self.get_categories()
self.model=self.create_model(load_weights=True)
def get_dataset(self):
df_train = pd.read_csv('./datasets/train.txt', header=None, sep=';', names = ['Input','Sentiment'], encoding='utf-8')
df_test = pd.read_csv('./datasets/test.txt', header=None, sep=';', names = ['Input','Sentiment'], encoding='utf-8')
df_val = pd.read_csv('./datasets/val.txt', header=None, sep=';', names = ['Input','Sentiment'], encoding='utf-8')
df_full = pd.concat([df_train,df_test,df_val], axis=0)
return df_full
def text_preprocessing(self,df,col_name):
column = col_name
df[column] = df[column].apply(lambda x:str(x).lower())
df[column] = df[column].apply(lambda x: th.cont_exp(x))
df[column] = df[column].apply(lambda x: th.remove_emails(x))
df[column] = df[column].apply(lambda x: th.remove_special_chars(x))
df[column] = df[column].apply(lambda x: th.remove_accented_chars(x))
return df.copy()
def inspect_dataset(self,df):
print(df.head())
if 'Sentiment' in df.columns:
print(df.Sentiment.unique)
def clean_dataset(self,df) -> pd.DataFrame:
cdf=self.text_preprocessing(df, 'Input')
cdf['num_words'] = cdf.Input.apply(lambda x: len(x.split()))
cdf['Sentiment'] = cdf.Sentiment.astype('category')
cdf['Sentiment'] = cdf.Sentiment.cat.codes
cdf_copy=cdf.copy()
return cdf_copy
def get_categories(self):
return {'anger':0, 'fear':1, 'joy':2, 'love':3, 'sadness':4, 'surprise':5}
def split_dataset(self,df):
return train_test_split(df, test_size = 0.3, random_state = 42, stratify = df.Sentiment)
def get_tokenizer(self):
# tokenizer = AutoTokenizer.from_pretrained('bert-base-cased')
# tokenizer.save_pretrained('./bert_model/bert-tokenizer')
tokenizer = AutoTokenizer.from_pretrained('./bert_model/bert-tokenizer')
#shutil.make_archive('bert-tokenizer', 'zip', './bert_model/bert-tokenizer')
return tokenizer
def create_model(self,train_set=None, test_set=None, tokenizer=None, load_weights=False):
# bert = TFBertModel.from_pretrained('bert-base-cased')
bert = TFBertModel.from_pretrained('./bert_model/bert-model')
# bert.save_pretrained('./bert_model/bert-model')
# shutil.make_archive('bert-model','zip','./bert_model/bert-model')
if train_set and test_set:
x_train = tokenizer(
text=train_set.Input.tolist(),
add_special_tokens=True,
max_length=70,
truncation=True,
padding=True,
return_tensors='tf',
return_token_type_ids = False,
return_attention_mask = True,
verbose = True)
x_test = tokenizer(
text=test_set.Input.tolist(),
add_special_tokens=True,
max_length=70,
truncation=True,
padding=True,
return_tensors='tf',
return_token_type_ids = False,
return_attention_mask = True,
verbose = True)
max_len = 70
input_ids = Input(shape=(max_len,), dtype=tf.int32, name="input_ids")
input_mask = Input(shape=(max_len,), dtype=tf.int32, name="attention_mask")
# embeddings = dbert_model(input_ids,attention_mask = input_mask)[0]
embeddings = bert(input_ids,attention_mask = input_mask)[0] #(0 is the last hidden states,1 means pooler_output)
out = tf.keras.layers.GlobalMaxPool1D()(embeddings)
out = Dense(128, activation='relu')(out)
out = tf.keras.layers.Dropout(0.1)(out)
out = Dense(32,activation = 'relu')(out)
y = Dense(6,activation = 'sigmoid')(out)
model = tf.keras.Model(inputs=[input_ids, input_mask], outputs=y)
model.layers[2].trainable = True
# for training bert our lr must be so small
optimizer = Adam(
learning_rate=5e-05, # this learning rate is for bert model , taken from huggingface website
epsilon=1e-08,
decay=0.01,
clipnorm=1.0)
loss =CategoricalCrossentropy(from_logits = True)
metric = CategoricalAccuracy('balanced_accuracy'),
model.compile(
optimizer = optimizer,
loss = loss,
metrics = metric)
tf.config.experimental_run_functions_eagerly(True)
tf.config.run_functions_eagerly(True)
#Load weights
if load_weights:
model=self.load_model_weights(model)
return model
def load_model_weights(self,model):
model.load_weights('./model_weights/sentiment_weights.h5')
return model
def predict(self, model, text,encoded_dict,tokenizer):
x_val = tokenizer(
text=text,
add_special_tokens=True,
max_length=70,
truncation=True,
padding='max_length',
return_tensors='tf',
return_token_type_ids = False,
return_attention_mask = True,
verbose = True)
validation = model.predict({'input_ids':x_val['input_ids'],'attention_mask':x_val['attention_mask']})*100
predictions={}
for key , value in zip(encoded_dict.keys(),validation[0]):
predictions[key]=value
return predictions
def get_sentiment_prediction(self, text):
prediction= self.predict(self.model,text,self.categories, self.tokenizer)
return prediction
if __name__=='__main__':
# print('Loading dataset...')
# df=get_dataset()
# print('clean dataset...')
# cdf=clean_dataset(df)
# print('inspecting...')
# inspect_dataset(cdf)
# print('spliting...')
# train_set, test_set=split_dataset(cdf)
sa = Sentiment()
prediction= sa.get_sentiment_prediction("I am happy")
print(prediction)
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment