finalized code

.ipynb_checkpoints/Untitled-checkpoint.ipynb

+{
+ "cells": [],
+ "metadata": {},
+ "nbformat": 4,
+ "nbformat_minor": 4
+}

README.md

+Commands
+1. npm start
+2. python audio_to_text.py
\ No newline at end of file

accuracy_check.txt

+I dropped out of college after the first 6 months, but then stayed around as a drop in for another 18 months or so. My biological mother was a young unwed graduate student and she decided to put me up for adoption. My biological mother found out later that my mother had never graduated from college and if my father had never graduated from high school, she refused to sign the final adoption papers. The only relented, a few months later when my parents promised that I would go to college, this was the start in my life. And all of my working-class parent’s savings were being spent on my college tuition. I have no idea what I wanted to do with my life and no idea how College was going to help me figure it out.
\ No newline at end of file

credentials.json

 {
   "type": "service_account",
-  "project_id": "endless-gizmo-328004",
-  "private_key_id": "9410846e78f7f7c0a1edd0392dae993436817e5f",
-  "private_key": "-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQDNSmsRP0cOqVuC\nzH1+0D+W617Wax7lcjWfjS6J9FR7xkEWseErlJiHw6tmz7tJmd/LhosRGwDcdLuJ\nqkvzZACQ5bnphzBFmJo/tDYKUeCYihFohcE2lr0p2Ln5szOAHfZZLmwdmI+XETS3\nkhLxk8XH+M6yrs35GfU6a6t0CBKn9jijRYzgeMZws+QWhGaDokKoJIcjWaXrA1TF\nWC0TrJRgJSO7jHPQ7sh5tQyc+xgmUYmcQkr8yo8sQnfZ+ZKP02bprvRZ/kt0OcFV\n5t25aM/3jRZ2eNxez3sZBnd9wef7vA2b+iT/xR/O+0y+xMtFsHAUg62tOrbhAO4U\nZtaJtguvAgMBAAECggEARafzjkWXOa1TRJ1YE5hbizzP0BdGw3muIjYITXze0aSi\nXy36BgyEeMR2uwrPNJkGa4t6UlKER0lAfOSQosQSwReBrnBVe7fc1rKyB2xitb9b\nSsjfl0Msai+EYupgFh+UgAwVWTFzv0FyTrs8vEV0vXZ5w/02HEingawY3+UBV4XD\nTYxMqpGtOWqe4yAXcATkK2Plz3MHSOZ+eIEYdzlNI/O2CJQzmbUEmFKHuze+1JS4\nKWz9aobmHsc4rXoJozU+7N4ApBvjMPrCskiZxWKUDfDT4E8IYYQKNQvl34/j69N9\nPGRmUmHzG3dqwjPm9QSCuBjBupoTL7cwrxHS0NvTmQKBgQDwye2M4OGDlVeKCuAy\nA+OYXTIZEwihJJmZ/qAEWtMwV2GM2OcPVnA52bcb0AUIIk/4tjW24NKZXktx23qP\nMu+IZG4GetuSzbc5c+K6ClIx/EGzXBy4ELlmVISZgyHbbPxBPs3XjuS75FrhPj6T\nSiDjeGuXHUy8lGKaoGoajPtGawKBgQDaQmj0iJtZtTL5DpDYqewXOxf+Dl9sdL86\nPa5xaEbnS4mOSzXBVo6l3U4lgc2YmxlsLC47H9g5hhzKSHdbKigUDTcacjYU44yE\nBpZkPs3vQ6mVToX+JZS7SuyZVkz7X3mMnCZXp6YtoYpNWBXYSA4Mx/w1DeZhzDSX\njp73tJX4zQKBgQC4mseyG3MqE6QypFXwYoTqeoD/MlWKXeoZY1rBG/UP+d5DQsQb\nQTT3VVCKVTiWXOAdGW0jEUjE5sNGvnM/OFjmo8Cq3SRcb7VKqesooOMViYXBghxO\njhvmNWQX4a5icTMQvprH6bi5yMBYMgV9nPaMDvXFvGPprIXQcK4IPxAikwKBgCcZ\nFmwXvJyJVSRAc7ocVmqi711XfciT8V2hhwpRv8HXSkDvQCXuN4eG6WTWp9najudN\n0spMnhNP7wBdkuQF3UAaTfCy3PVI/fb4pyA2D/X4jPxuIJqyaL5UYaXmS8wMAl4p\n6sRxB9fMxFWundssrTek640lfEuwpQsxRVDiTKtRAoGACoCSWwV2KQIYs2il3AJ3\neBPKtzuPHCywc+ZJpJtxtta9O3SAMgmx71K/uLRJJNdjtNdYgG1ppuHQbO7o3KVn\nqHlQH7SQLhCTVMNFzvtkMdUkX9F398o9QaBGCCU1Biq+Zy0a+HlCXeF71iFLOyz+\nc8MPJThA+eH2+ewY5Sa8VnY=\n-----END PRIVATE KEY-----\n",
-  "client_email": "eduhelp@endless-gizmo-328004.iam.gserviceaccount.com",
-  "client_id": "111500483523117832406",
+  "project_id": "robust-doodad-317814",
+  "private_key_id": "b6c4030fe5c75e8cd7554511fa22479feced3b5e",
+  "private_key": "-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQCSchTbX5MbhKMS\nCkSjGIRFBqxHr1NvOzusDWf2jzkoeqpUoTOuIzudt7GnJ6dmBKVOZyvtGa1nuh8U\np2pDkXMtCR/DP+lbI/SxdFYem52stljMmSrFVgB3q6AyN9W1jlGow3d8s8ZUnfns\nLs/ZSf62OsPyRtpLO2yqr+e7+UQvYKd1CEds4XddK1P9Dz2fYvwJml3cJJpJER4n\nOt8+YM3eCVGcuLKcNROscEAlvLZLL1hslVdYAYMPvZys9ViwJylrMg97ntXwRF0I\nCBXpDkY9jfVaqORdZxfx+BuFIEk7LisEDDD/zIH03GZmDxPVi4uSH6lyA/8LfK3A\ntP5+LQWdAgMBAAECggEADWNnm7yrnsbr/6C3sK9znDnlczJIrvEb3fllyUlDwPsh\n6lXIe0GWWC9siusZpz6CfF37SpRf4Y1G/STnFqFMBdCBOmDz7RSm8LhBjU/NxPXw\nvVe9bMgVh9tFbIHlRFFsDsE8AccPuTmuGRUYhHV6118c/d/TYjBfGWW2il1aCfip\nPmPLMFhFu+o3lLz0XZNGoNIub5qEQc5mPtLJdGRu49VZj+WluODxeIPeSCSQRjbc\nez0AdY8otxiSAqRHPXWUXZ3ZPUXx3d/UWAuR5F8Ag1GLvJMkdMa07SKFynlA/Jrb\nglaXlbhc+Zl85yU0fjx37plriViylwj2tsVcHmlXUQKBgQDEZtVsKrduLcEjeefe\nM8R9mSnhDq96ImFKFFaDKVEFqOJPkkeYg0JRMbrz/Kp6P27MbuPVIv2pfIz4b5TS\ndLEM474vKu3d+7zkpxZPikjIc5z0cxAhjQNAfHvAviaUYQntoshKbkzt3X/z0PxI\nPk+1PfplNL2vnU7jUQnwPOlhJQKBgQC+4ny1Av5i/WIitp4AGECXmfT+s9K/MHb0\n0I6CRdFzz12ukApx26YoADzQw4liBL00rHg+6L3vvU6Lym218spFJ3/jg7iW4wCt\njtvF5xjbaWsNKYerNfISYvHAML6jRqHwNM2ik3dNbAxKkAbpRG4ZPJEEzKg47LEa\nJ7ZiEviVGQKBgEa4vNtRWnHrOeP7brn9rCCJ+aGX9yoknSHexvQ9+XXvRWbfxrYt\ndcDlBmv7LKwOkWg9+f5ytiLEvcJr84wBBwwcKgy0Caloj7FKVWdY5TKBJyCDGmjq\nbSRYbvuNvTiq5LdUaYkbxMnWe8+hDmc5QNyDr9mnrzJAk/qY4NpIJMWdAoGBAKhS\nE2GSmDs18BloKv8uY5bLPcxzST0qQVszpNafNkkG7DcH8Q3hgCz5uKbmJfj28NjH\n1Oi0VvhWWDLQd9nflBlS8WTwPA9hcLGarZVfaP3hgXKD0oxY73LjKQYudYyItjeY\neFQJ8UOmKVh+lHmRy/wY+k/fH9/CZ5EGv77Pt7/RAoGAXMEpCQ4bDZo9su7mqmg3\nvxPfD+iT3TpjY5wOZHBSl1tY5i9gigFgiPGdDs66ug3L3T/ds690L5S/oNTwB6jK\nuPt8IhNhg7VSXN6MJ9g72jvO21kE59KsE6rfx2q35gYkCAUtXCogSLTqyD549Xi8\nONUUxVOW8fr+ww3xVrXlZOc=\n-----END PRIVATE KEY-----\n",
+  "client_email": "eduhelpcom2@robust-doodad-317814.iam.gserviceaccount.com",
+  "client_id": "107956975271729952596",
   "auth_uri": "https://accounts.google.com/o/oauth2/auth",
   "token_uri": "https://oauth2.googleapis.com/token",
   "auth_provider_x509_cert_url": "https://www.googleapis.com/oauth2/v1/certs",
-  "client_x509_cert_url": "https://www.googleapis.com/robot/v1/metadata/x509/eduhelp%40endless-gizmo-328004.iam.gserviceaccount.com"
+  "client_x509_cert_url": "https://www.googleapis.com/robot/v1/metadata/x509/eduhelpcom2%40robust-doodad-317814.iam.gserviceaccount.com"
 }

documents/10_final_test_five.txt

-Your story is about connecting the dots.
- I dropped out of college after the first 6 months, but then stayed around.
- Is a drop in for another 18 months or so before I really quit.
- So why should I Dropout? It started? Before I was born.
- My biological mother was a young unwed graduate student and she decided to put me up for adoption.
- You felt very strongly that I should be adopted by college graduates.
- So everything was all set for me to be adopted at Birth by a lawyer and his wife, accept it.
- When I popped out, they decided at the last minute that they really wanted a girl.
- So my parents who are on a waiting list, got a call in the middle of the night.
- Asking we got an unexpected baby boy.
- Do you want him? They said, of course, my biological mother found out later that my mother had never graduated from college.
-.

documents/10_pp3te.txt

-Your story is about connecting the dots.
- I dropped out of college after the first 6 months, but then stayed around.
- Is a drop in for another 18 months or so before I really quit.
- So why should I Dropout? It started? Before I was born.
- My biological mother was a young unwed graduate student and she decided to put me up for adoption.
- You felt very strongly that I should be adopted by college graduates.
- So everything was all set for me to be adopted at Birth by a lawyer and his wife, accept it.
- When I popped out, they decided at the last minute that they really wanted a girl.
- So my parents who are on a waiting list, got a call in the middle of the night.
- Asking we got an unexpected baby boy.
- Do you want him? They said, of course, my biological mother found out later that my mother had never graduated from college.
-.

documents/10_pp3test.txt

-Your story is about connecting the dots.
- I dropped out of college after the first 6 months, but then stayed around.
- Is a drop in for another 18 months or so before I really quit.
- So why should I Dropout? It started? Before I was born.
- My biological mother was a young unwed graduate student and she decided to put me up for adoption.
- You felt very strongly that I should be adopted by college graduates.
- So everything was all set for me to be adopted at Birth by a lawyer and his wife, accept it.
- When I popped out, they decided at the last minute that they really wanted a girl.
- So my parents who are on a waiting list, got a call in the middle of the night.
- Asking we got an unexpected baby boy.
- Do you want him? They said, of course, my biological mother found out later that my mother had never graduated from college.
-.

documents/11_gradhhescience10s.txt

-Do you know anyone who's a lifer have you heard this expression lifer? Let's 
-listen to a couple of examples, and then we'll talk about what this slang expression  Means.
- If you don't study hard, you'll end up a lifer at McDonald's.
- I think Jim is going to be a lifer.
- He has zero ambition to do anything new, or you able to guess 
-what life remains from the examples, as somebody who stays at the same job for the whole life  And we particularly use this expression to describe people who work in dead-end, 
-jobs  So jobs that are minimum wage or undesirable jobs that have no opportunities 
-for career advancement  So life for somebody in a dead-end job that will stay there for 
-the whole life  Hope you learned something new today.
- That is it for me.
- I'll talk to you next time.
- See you later.
-.

documents/11_p2_new.txt

-According to one of the definitions, the knowledge gained through observations and experimentation is known as science.
- The knowledge, which is based upon the observations and experimentation is taken as a sign of fall in this category, cannot be taken as science deals with nature.
- It is also called natural philosophy.
- The basic and principal focus on science is to study nature and that is why it was all to call Natural philosophy.
- That means an organized, the study of nature of has been divided into two branches that are two basic branches of science.
- And one of them is the biological sciences that deals with the study of.

documents/11_pp2_new.txt

-According to one of the definitions, the knowledge gained through observations and experimentation is known as science.
- The knowledge, which is based upon the observations and experimentation is taken as a sign of fall in this category, cannot be taken as science deals with nature.
- It is also called natural philosophy.
- The basic and principal focus on science is to study nature and that is why it was all to call Natural philosophy.
- That means an organized, the study of nature of has been divided into two branches that are two basic branches of science.
- And one of them is the biological sciences that deals with the study of.

index.js

+const express = require("express");
+const app = express();
+const cors = require("cors");
+
+const PORT = 3001;
+
+app.use(express.json());
+app.use(cors());
+
+const uploadRoute = require("./routes/upload");
+app.use("/upload", uploadRoute);
+
+
+app.listen(PORT, () => {
+  console.log(`Server Running on Port ${PORT}...`);
+});
+

package.json

+{
+  "name": "server",
+  "version": "1.0.0",
+  "description": "",
+  "main": "index.js",
+  "scripts": {
+    "start": "node index.js",
+    "devStart": "nodemon index.js"
+  },
+  "author": "",
+  "license": "ISC",
+  "dependencies": {
+    "cors": "^2.8.5",
+    "express": "^4.17.1",
+    "fs": "0.0.1-security",
+    "line-reader": "^0.4.0",
+    "multer": "^1.4.3",
+    "mysql": "^2.18.1",
+    "mysql2": "^2.2.2",
+    "nodemon": "^2.0.4",
+    "path": "^0.12.7",
+    "sequelize": "^6.3.5",
+    "sequelize-cli": "^6.2.0"
+  }
+}

requirements.txt

+spacy==3.0.6
+SpeechRecognition==3.8.1
+watchdog==0.10.2
+docx==0.2.4
+moviepy==1.0.3
+pydub==0.25.1

routes/db.js

@@ -3,7 +3,7 @@ var mysql = require('mysql');
 var con = mysql.createConnection({
   host: "localhost",
   user: "root",
-  password: "Chintha1..",
+  password: "root",
   database : 'eduhelp'
 });
 

routes/upload.js

@@ -9,12 +9,11 @@ var mysql = require('mysql2');
 var con = mysql.createConnection({
   host: "localhost",
   user: "root",
-  password: "Chintha1..",
+  password: "root",
   database : 'eduhelp'
 });
 
 const summaryFolder = './summarized_doc/';
-const fullFolder = './documents/';
 
 const storage = multer.diskStorage({
     destination: "./Videos",
@@ -34,35 +33,18 @@ route.post('/video', upload,(req, res) =>{
 
 route.post('/getDoc', (req, res) =>{
     var files_list = []
-    folderPath =""
-    if(req.body.id ==0){
-        folderPath = fullFolder
-    }else{
-        folderPath = summaryFolder
-    }
-
-    fs.readdir(folderPath, (err, files) => {
+    fs.readdir(summaryFolder, (err, files) => {
         files.forEach(file => {
-            console.log(files)
             fn = file.split("_");
-            if(fn[0] == req.body.type)
+            if(fn[0] == req.body.id)
                 files_list.push(file.split('.')[0])     
         });
-        console.log(files_list)
         res.send(files_list);
       });
 })
 
 route.post('/getDocData', (req, res) =>{
-   // console.log(req.body)
-    folderPath =""
-    if(req.body.folder ==0){
-        folderPath = fullFolder
-    }else{
-        folderPath = summaryFolder
-    }
-
-    fs.readFile(folderPath+'/'+req.body.id+'.txt', { encoding: 'utf8' } , (err, data) => {
+    fs.readFile(summaryFolder+'/'+req.body.id+'.txt', { encoding: 'utf8' } , (err, data) => {
         if (err) {
           console.error(err)
           return

summarization_accuracy.py

@@ -19,7 +19,6 @@ for para in doc.paragraphs:
 with open(accuracy_check_file, 'r') as file:
     content = file.read()
 
-#Calculate the common words in the summary from the online tool and in the summary from our system.
 no_of_overlapping_words = 0
 
 for word in AllWords[0]:
@@ -35,7 +34,7 @@ content_words.append(content.split(" "))
 total_words_in_reference_summery = len(content_words[0])
 
 # In terms of precision, what you are essentially measuring is, how much of the system summary 
-# To calculate the accuracy no of overlapping words deviding total words in system summery
+# was in fact relevant or needed?
 precision = no_of_overlapping_words / total_words_in_system_summery
 
 # Recall in the context of ROUGE means how much of the reference summary is the system 
@@ -46,15 +45,3 @@ print("Precision and Recall in the Context of ROUGE")
 print("--------------------------------------------")
 print("Recall: "+str(recall))
 print("Text Summerization Accuracy(Precision): "+str(precision))
-
-#Suppose there are 100 words in the document summarized using the online tool.
-  #online tool = 100
-
-#Suppose there are 120 words in the document summarized using our system.
-  #system = 120
-
-#The number of common words in our system and in the online tool = 80
-
-# To calculate the accuracy no of overlapping words deviding total words in system summery
-
-    # Accuracy= 80/120
\ No newline at end of file

summarized_doc/10_final_test_five.txt

-They said, of course, my biological mother found out later that my mother had never graduated from college..
-My biological mother was a young unwed graduate student and she decided to put me up for adoption.
-I dropped out of college after the first 6 months, but then stayed around.
-You felt very strongly that I should be adopted by college graduates.
-So my parents who are on a waiting list, got a call in the middle of the night.

summarized_doc/10_ggg.txt

-He has zero ambition to do anything new, or you able to guesswhat life 
-remains from the examples, as somebody who stays at the same job .for the .
-
-whole life .And .
-So life for somebody in a dead-end job that will stay there forthe whole 
-life   we particularly use this expression to describe people who work in dead-end,jobs  .
-So jobs that are minimum wage or undesirable jobs that have no opportunitiesfor career 
-advancement   
\ No newline at end of file

summarized_doc/10_pp3test.txt

-They said, of course, my biological mother found out later that my mother had never graduated from college..
-My biological mother was a young unwed graduate student and she decided to put me up for adoption.
-I dropped out of college after the first 6 months, but then stayed around.
-You felt very strongly that I should be adopted by college graduates.
-So my parents who are on a waiting list, got a call in the middle of the night.

summarized_doc/10_sceince.txt

+Terrestrial plants obtain water from soil for photosynthesis. Water in the soil is
+absorbed through root hairs by osmosis. The absorbed water then travels into
+root xylem through cortex and endodermis. From there water is transported into
+mesophyll cells of leaves via the xylem of stem and the veins of leaves. The network
+of veins in the leaves distribute water throughout the leaf.
\ No newline at end of file

summarized_doc/11_p2_new.txt

-The knowledge, which is based upon the observations and experimentation is taken as a sign of fall in this category, cannot be taken as science deals with nature.
-That means an organized, the study of nature of has been divided into two branches that are two basic branches of science.

summarized_doc/11_science.txt

-The knowledge, which is based upon the observations and experimentation is taken as a sign of fall in this category, cannot be taken as science deals with nature.
-That means an organized, the study of nature of has been divided into two branches that are two basic branches of science.

summarized_doc/11_test.txt

-The knowledge, which is based upon the observations and experimentation is taken as a sign of fall in this category, cannot be taken as science deals with nature.
-That means an organized, the study of nature of has been divided into two branches that are two basic branches of science.

summarized_doc/summarized_doc.txt

-They said, of course, my biological mother found out later that my mother had never graduated from college.. 
-My biological mother was a young unwed graduate student and she decided to put me up for adoption. 
-I dropped out of college after the first 6 months, but then stayed around. 
-You felt very strongly that I should be adopted by college graduates. 
-So my parents who are on a waiting list, got a call in the middle of the night.
\ No newline at end of file