Scribd Logo
Upload

Welcome to Scribd!

  • 34 views

    Human Activity Recognition Synopsis

    Uploaded by

    APS Placements
    This document discusses human activity recognition (HAR) and proposes a system to recognize human actions from video data using deep learning models. It begins with an introduction to HAR and its applications. It then describes existing approaches like HOG+SVM and their limitations. The proposed system would use a ResNet-34 3D convolutional neural network trained on a Kinetics dataset to recognize patterns in video frames and classify human activities in real-time. It aims to both recognize actions and provide captions and speech output to describe the actions to the user. The system could help with applications like abnormal event detection and crowd analysis during the COVID-19 pandemic. It discusses collecting a dataset from volunteers and recognizing activities important to everyday life. Overall accuracy and reducing computational

    Copyright:

    © All Rights Reserved
    Download as DOCX, PDF, TXT or read online from Scribd

    Human Activity Recognition Synopsis

    Uploaded by

    APS Placements
    34 views4 pages
    This document discusses human activity recognition (HAR) and proposes a system to recognize human actions from video data using deep learning models. It begins with an introduction to HAR and its applications. It then describes existing approaches like HOG+SVM and their limitations. The proposed system would use a ResNet-34 3D convolutional neural network trained on a Kinetics dataset to recognize patterns in video frames and classify human activities in real-time. It aims to both recognize actions and provide captions and speech output to describe the actions to the user. The system could help with applications like abnormal event detection and crowd analysis during the COVID-19 pandemic. It discusses collecting a dataset from volunteers and recognizing activities important to everyday life. Overall accuracy and reducing computational

    Original Title

    HUMAN ACTIVITY RECOGNITION SYNOPSIS

    Copyright

    © © All Rights Reserved

    Available Formats

    DOCX, PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    This document discusses human activity recognition (HAR) and proposes a system to recognize human actions from video data using deep learning models. It begins with an introduction to HAR and its applications. It then describes existing approaches like HOG+SVM and their limitations. The proposed system would use a ResNet-34 3D convolutional neural network trained on a Kinetics dataset to recognize patterns in video frames and classify human activities in real-time. It aims to both recognize actions and provide captions and speech output to describe the actions to the user. The system could help with applications like abnormal event detection and crowd analysis during the COVID-19 pandemic. It discusses collecting a dataset from volunteers and recognizing activities important to everyday life. Overall accuracy and reducing computational

    Copyright:

    © All Rights Reserved
    Download as DOCX, PDF, TXT or read online from Scribd
    Download as docx, pdf, or txt
    34 views4 pages

    Human Activity Recognition Synopsis

    Uploaded by

    APS Placements
    This document discusses human activity recognition (HAR) and proposes a system to recognize human actions from video data using deep learning models. It begins with an introduction to HAR and its applications. It then describes existing approaches like HOG+SVM and their limitations. The proposed system would use a ResNet-34 3D convolutional neural network trained on a Kinetics dataset to recognize patterns in video frames and classify human activities in real-time. It aims to both recognize actions and provide captions and speech output to describe the actions to the user. The system could help with applications like abnormal event detection and crowd analysis during the COVID-19 pandemic. It discusses collecting a dataset from volunteers and recognizing activities important to everyday life. Overall accuracy and reducing computational

    Copyright:

    © All Rights Reserved
    Download as DOCX, PDF, TXT or read online from Scribd
    Download as docx, pdf, or txt
    of 4

    Introduction:

    Recently, automation system has drawn much attention for industrial as well as
    academic research and Human Activity Recognition (HAR) system is one of them in the field
    of computer vision analysis technology . Due to the mounting demands from numerous
    applications like in medical or healthcare systems, security, visual monitoring, video
    acquisition, entertainmentas well as abnormal activity monitoring to capture glimpses of what
    is going on as well as thedetection of illegal or possibly harmful practises. Similarly, inthe area
    of entertainment, HAR also helps to improve the performance of Human Computer Interaction
    (HCI), Furthermore, HAR also play a vital role in a healthcare system to recognize the
    activityof the rehabilitation of patients like their action and behaviour to facilitate the
    rehabilitation processes. Many scholars have attempted to use the HAR method, especially in
    regards to abnormal activities in home, human activity, sports and street activity, healthcare
    monitoring and many more application in their studies. In this review paper, the computer
    vision-based technologies for recognition of human activity or abnormal behaviours using the
    concept of demanding and computationally intelligent classification techniques like deep
    learning and machine learning will be extensively reviewed and discussed with challenges and
    future possibilities. An action in the HAR mechanism may be witnessed by using the human
    eye or by the use of some kind of visualization or sensing technologies. The actual activity of
    the individual in the field of view must be constantly monitored for the operation to be properly
    performed. Based on the type of involved body parts used for motion, human actions may be
    divided into four categories:
    Facial and walking: It is focused on the action of a human’s face, or other body parts when
    walking, with no requirement of verbal contact.
    • Action: it is just a series of gestures performed by humans such as running or sitting or
    walking.
    • Interaction: It is also an important aspect that incorporates individual actions to be
    executed by human. Interaction can be with individual or single person.
    • Group Activity: It may be a mix of human movements, behaviours, acts, or
    interactions. Here, number of performers can be performed at a time but at least two or more
    objects or person needed for the interaction.

    1
    Problem Statement:

    Many researchers have contributed innovative algorithms and approaches in the


    area of human action recognition system and have conducted experiments on
    individual data sets by considering accuracy and computation. In spite of their efforts,
    this field requires high accuracy with less computational complexity. The existing
    techniques are inadequate in accuracy due to assumptions regarding clothing style,
    view angle and environment. Hence, the main objective of this thesis is to develop an
    efficient multi-view based human action recognition system using shape features.
    During the development phase, the following two objectives have been conceived in
    the proposed approach: Primary Objective – to develop an efficient human action
    recognition system using multiple views. Secondary Objective – to understand human
    behavior model using probabilistic action graph.

    Existing System:
    The most successful and popular vector-form feature: histograms of oriented
    gradients (HOG) It is shown that the HOG features are based on the contrast of silhouette
    contours against the background. Despite all the difficulties on human detection, a lot of
    work has been done recent years. First, we may use different features such as edge, Haar
    features and gradient orientation features; second, we may use different classifiers such as
    Nearest Neighbor, Neutral Network, SVM and Adaboost the second step of human
    detection is designing classifier. Large generalization ability and less classifying
    complexity are two important criteria for selecting classifiers. Linear support vector
    machine (SVM) and AdaBoost are two widely-used classifiers satisfying the criteria. So
    the traditional approach of AdaBoost for face detection and has demonstrated both high
    recognition accuracy and fast run-time performance. However, in most cases the
    classification accuracy is lower than that of the first proposed algorithm based on HOG+
    SVM.

    Proposed system and Objective:


    Methodology of Human Activity Recognition include several steps of processing
    from taking the input, identifying the similar patterns, comparing the frames with the
    Kinetic dataset, recognizing the actions and providing the context and speech of the action

    2
    to the video frames.

    Dataset: A kinetics dataset which consists of 400 human activities is used for prediction
    and comparison of the input data. Kinetics dataset are taken from YouTube recordings.

    The activities are human focuses and cover a wide scope of classes including human-object
    communications, for example mowing lawn, washing dishes, humans Actions e.g. Since
    the dataset is huge and downloading each clip would be a waste of time given that we
    already have pre-trained models by the original author. It will be easy and provides
    accurate results when worked on the pre-trained model than to train and tune it separately.

    1. Recognition of the action:

    The kinetic dataset is used by the ResNet_34 3D model to compare similar


    patterns in the input data frames that are captured in the intervals. The similar patterns can
    be identified by CNN trough pooling layer by layer. The identified actions are categorized
    into classes of human activities. The recognition of the data input can be done by
    Resnet_34 model by video classification of 3D kernels. Segmentation of the actions are
    the classes which are identified by the model.

    2. Context and Speech output of the action:

    Through the programming in python the captioning of the activity that is identified
    by the model can be displayed in the video while execution of the input file.
    Simultaneously, the speech of the activity that is captioned will be produced.

    3. Recognition of the action:

    The kinetic dataset is used by the ResNet_34 3D model to compare similar


    patterns in the input data frames that are captured in the intervals. The similar patterns can
    be identified by CNN trough pooling layer by layer. The identified actions are categorized
    into classes of human activities. The recognition of the data input can be done by
    Resnet_34 model by video classification of 3D kernels. Segmentation of the actions are
    the classes which are identified by the model.
    Detecting human beings accurately in a visual surveillance system is crucial for diverse application
    areas including abnormal event detection, human gait characterization, congestion analysis, person
    identification, gender classification and fall detection for elderly people. The biggest use of such

    3
    system is during the ongoing Worldwide Covid-19 Pandemic where intelligent tracking of mass
    gathering is of utmost importance to avoid the community spread of the disease. As the system comes
    with Real-time human counting, based on the statistics the task of the governing body gets reduce
    significantly to identify crowdy places or streets with the help of the proposed system respectively

    Scope of the Project:


    Human action acknowledgment intends to distinguish the activities did by an
    individual susceptible to him which are done as often as possible in his everyday
    existence as for the general condition.
    Acknowledgment can be practiced by abusing the data recovered from different
    sources, for example, condition by utilizing sensors. In this task we gather dataset from
    30 volunteers going from 19-48 years and we process the information utilizing
    calculation. Human action acknowledgment assumes a noteworthy job in human-to-
    human communication and relational relations.
    Conclusion:
    Understanding the human activity and their interaction with the surrounding
    objects is a key element for the development of intelligent system. Human action
    recognition is a field that deals with the problems generates in the integration of sensing
    and reasoning, to provide context aware data that can be confer the personalized support
    across an application. In the human action recognition system, still there are various
    issues which need to be addressed like as battery limitation of wearable sensors, privacy
    concern regarding continuous monitoring of activities, difficulty in performing HAR
    (Human activity recognition) in real time and lack of fully ambient systems able to
    reach users at any time.

    Project Guide Project Coordinator HOD


    Prof. Shruthi Dr. Nandeshwar SB Dr Kumar B.I.D

    You might also like