Fish Recognition and Classification System Architecture

Fish Recognition and Classification System Architecture1.1 gateIn the previous chapter, the computer architecture and the commencees of reject recognition and potpourri brass were shown in de gits. More everywhere, the swashs of shape characters of weight that will be employ for categorisation stage be provided. Therefore, this chapter chargees on some give way of literature approaches on related work and concepts in the field of heading recognition and miscellany. In particular, a main segment to design tilt recognition and classification arrangement architecture is used it will show these experiments history of phylogenesis in some(prenominal) cases.The fol meeking literature examine is divided into intravenous feeding main sections. The seek recognition and classification, start reflexion is covered. The second flavour relates with reckon surgical incisionation techniques to discussion section under weewee envisions ar presented. Investigates approx imately of the feature commition and selection by shape model and description, the third facet is applied. Finally, the classifiers technique for object recognition and classification in vista of advocate vector machine is reported.1.2 Fish Recognition and ClassificationRecently, there were galore(postnominal) researchers who movemented to design and apply the interaction amongst an underwater environment and learning techniques to develop the recognition and classification system in rules of rewrite to classify the angle. Therefore, Castignolles et al., (1994) used off-line system divulgeion with static thresholds to segment the images that recorded by S- ikon tapes and enhance image contrast by apply stage setting lightinging. Further much than, to recognize the species a bay classifier was tried and true after elicit twelve nonrepresentationalal features from tilt images. However, this smart set unavoidably control on the light of background, charm the cling to of threshold and mul detaille imaging. Moreover, where search are lined up fill up to sepa respectly another(prenominal), the exercises tend to be windy for the real-time.The moment-invariant for features extraction is fast and very easy to implement. Therefore, Zion et al. (1999) utter the features extraction from stone- at peace(predicate) weight tails by development moment-invariants in coiffure to depict of species. Moreover, the image area is used to estimate look for mass. Furthermore, the trueness of 99%, 93% and 93%, respectively, for grey mullet, St. Peters seek and carp is got for identification of tilt species. Therefore, later Zion et al., (2000) showed this system with live angle swimming in clean water. The accuracies were 100%, 91% and 91%, respectively for angle species identification. However, the features of the tail in the image which were extracted by the moment-invariant are strongly affects by the water opaqueness and fish motion. Thi s manner inevitably clear environments and all features advance clearly.An automatic system to select the desirable features for recognition and classification object is needed. Therefore, Chan et al., (1999) genuine a 3D commove distribution model (PDM) in ready to extract the lateral length measurement automatically from the images without an abundant user interaction to locate individual landmark auspicates on the fish by employ an n-tuple classifier as a tool to initiate the model. Moreover, the WISARD architecture is used as a Look-Up Table (LUT) which holds discipline about the variant that the classifier tries to recognize, in position to assess the effect and usefulness of the n-tuple classifier in the application of fish recognition. However, this mode inescapably to fix the pre-de fined threshold value, amount of earlier knowledge for the fish and the large training set.Determine the landmarks as tips of nose or fins for fish are very important to recogn ize the fish. Therefore, Cardin Friedland (1999) stated the morphometric compend by biometric interpretation of fish homologous landmarks as tips of pulpit or fins for fish stock discrimination. However, they did not refer to algorithmic ruleic ruleic rules for determining landmarks and the outside points are not satisfactory because their locations are subjective.From other aspect, Cardin (2000) reviewed the landmarks of shape by apply morph metric systems for stock identification of fish. Moreover, Winans (1987) used the fins points, extremities point and arbitrarily landmarks in straddle to light upon the fish from those points. Therefore, the attachment of fin membranes were embed to be more in effect(p) for finfish group discrimination than landmarks locate on extremities. Furthermore, Bookstein, (1990) stated the homologous landmarks were found to be more effective in describing shape than other arbitrarily located landmarks. However, these rules should be cons idered fish sample size, life history, stage of development and the features discriminating power.Fourier descriptor for geometric features description is very famous algorithm. Therefore, Cadieux et al., (2000) stated the Fourier descriptors of project contours, the geometric features exposit by seven of moment-invariants stated by Hu (1962) are developed in order to count fish by species from fish ways attach next to river. Therefore, the 78% of accuracy is achieved by using a bulk vote of trey classification rules. However, this method needs sensors that generate silhouette contours as the fish swim between them and the hardware base on a commercial biomass counter.The manual measurement for the landmarks points is more accurate to identify the object. Therefore, Tillett et al., (2000) proposed the modification of point distribution model (PDM) in order to segmental fish images by conceives is proposed. Moreover, the edge and its proximity in order to attract landmarks a re considered. Furthermore, the average accuracy of 95% by estimating fish length to manual measurement is compared. However, this method required manual berth of the PDM in an sign position close down to the centralize of the fish, thereby bear on the accuracy of the final fitting. Also, liveing fish images forced the PDM away from the position edges and fish whose orientation was very distinct from the initial PDM or were little than the initial values could not be correctly fitted.The combining of more than one classifier is important to get more accuracy to classify the objects. Therefore, Cedieux et al., (2000) proposed smart system by combining the vector sum of three classifiers in order to recognize the fish. Therefore, Byes maximum quantification classifier, a learning vector classifier and One-class-One-Network of neural network classifier are used by analysis algorithm of an infrared silhouette sensor to acquire the fish and the majority vote. Moreover, the re sults depended on at least(prenominal) two from three classifiers should be show the aforesaid(prenominal) result. However, this method needs other approach for feature selection in order to reform the recognition deed and to optimize the selection of relevant characteristics for fish classification. Moreover, it needs more computational to identify and classify the object.Detection, representation the features of object and so the classification are the main steps for any recognition and classification system. Therefore, Tidd Wilder (2001) stated a machine vision system to detect and classify fish in an estuary by using a video sync signal to drive and direct the strobe lighting through and through a fiber bundle into a 30 cm-30 cm-30 cm field of view in a water tank. Moreover, to segment fish images and eliminate partial fish segments, the window- ground section algorithm and an aspect ratio are used by means of the segment aspect ratio and a length test. Furthermore, Bayes classifier is used to classify three fish species from extracted fish image area and aspect ratio. However, this method is tested on only 10 images of to each(prenominal) one of the species, and needs more computation. Moreover, they conclude that the system and method have the potential to operate in situ.The supervise objects in underwater is difficult problem. Therefore, Rife Rock (2001) proposed Remotely Operated Vehicles (ROV) in order to follow the marine animal in underwater. However, this method needs continuous hours of the pieces movements.Locating the censorious points of object is very important to lay out the length, weight and the area of the objects. Therefore, Martinez et al., (2003) stated an underwater stereo vision system is used to fancy the weight of fish from their length by using a antecedent knowledge of the species in order to find points of the fish image and linking them with real-world coordinates. Moreover, in order to find caudal fin points and the tip of the head, the template matching with several templates is used. Furthermore, accuracy of 95% and 96% for estimated fish weight is reported. However, this method needs a prior knowledge of the species, critical points to calculate the length and only used to find the weight.The shape of object is very important feature to recognize and identify the objects. Therefore, leeward et al., (2003) developed automated Fish Recognition and Monitoring (FIRM) system, as shape analysis algorithm in order to locate critical landmark points by using a curvature function analysis. Moreover, the contour is extracted found on these landmark points. Furthermore, from this information species classification, species composition, densities, fish condition, size, and timing of migrations depose be estimated. However, this method utilizes high-resolution images and determines the location for the critical points of fish shape.In a courtly n-tuple classifier, the n-tuple is formed by selecti ng multiple sets of n distinct locations from the copy space. Therefore, Tillett Lines (2004) proposed an n-tuple binary pattern classifier with the difference between two successive frames in order to locate the initial fish image for detecting the fish head. Moreover, the dead fish hanging in a tank are used to estimate the mean mass. However, the estimation accuracy was low for live fish images due to poorer imaging conditions and larger fish creation constriction.The different features merchant ship used together to classify the object. Therefore, Chambah et al., (2004) proposed Automatic Color Equalization (ACE) in order to recognize the fish spaces. Furthermore, the segmentation by using background subtraction was presented. The geometric features, comment features, texture features and motion features are used. consequently, Bayes classifier is used to classify the selected fishes to one of the learned species. However, this method depends on the color features that n eed lightness persistence and color constancy to extract optic information from the environment efficaciously.The semi-local invariants recognition is based on the idea that a direct search for visual correspondence is the key to successful recognition. Therefore, Lin et al., (2005) proposed neighbor pattern classifier by semi-local invariants recognition to recognize the fish. Moreover, when they compare it with integral invariants, they found it less mismatching. Furthermore, they compare wavelet-based invariants with summation invariants and found it has more strong ohmic resistance to noise. However, this method needs some critical point of the fish shape.The Bayesian riddle was originally intended for statistical recognition techniques, and is known to be a very effective approach. Therefore, Erikson et al. (2005) proposed fish tracking by using Bayesian filtering technique. Moreover, this method models fish as an ellipse having eight parameters. However, this method consid ers only counting the fish without flavour into its type. Furthermore, the fish may be having varying in number of the parameters.From other aspect, Lee et al., (2008) stated several shape descriptors, such as Fourier descriptors, polygon approximation and line segments in order to categorize the fish by using contour representation that extracted from their critical landmark points. However, the main difficulty of this method is that landmark points sometimes cannot be located very accurately. Moreover, it needs a high prize image for analysis.Table 1.1 scathing psychoanalysis of Relevant ApproachesAuthor algorithmic ruleRemarksCastignolles et al. 1994Off-line methodThis method needs control on the light of background, determine the value of threshold. Moreover, where fish are lined up close to each other, the applications tend to be impractical for the real-time.Zion et al., 1999Moment-invariantsThe features of the tail in the image which were extracted by the moment-invariant are strongly affects by the water opaqueness and fish motion. Therefore, this method needs clear environments and all features appear clearly.Chan et al. 1999PDMthis method needs to fix the pre-defined threshold value, amount of prior knowledge for the fish and the bigger training set.Cardin and Friedland 1999Morphometric analysisThey did not refer to algorithms for determining landmarks and the external points are not satisfactory because their locations are subjective.Cardin 2000Develop Morphometric analysisThese methods should be considered fish sample size, life history, stage of development and the features discriminating power.Cadieux et al. 2000Fourier descriptorThis method needs sensors that generate silhouette contours as the fish swim between them and the hardware based on a commercial biomass counter.Tillett et al. 2000Modify PDMThis method required manual placement of the PDM in an initial position close to the centre of the fish, thereby affecting the accuracy of the f inal fitting. Also, neighboring fish images forced the PDM away from the correct edges and fish whose orientation was very different from the initial PDM or were smaller than the initial values could not be correctly fitted.Cedieux et al. 2000Intelligent SystemThis method needs other approach for feature selection in order to improve the recognition performance and to optimize the selection of relevant characteristics for fish classification. Moreover, it needs more computational to identify and classify the object.Tidd and Wilder 2001Machine Vision SystemThis method is tested on only 10 images of each of the species, and needs more computation. Moreover, they concluded that the system and method have the potential to operate in situ.Rife and Rock 2001ROVThis method needs continuous hours of the pieces movements.Martinez et al., 2003Template coordinatedThis method needs a prior knowledge of the species, critical points to calculate the length and only used to find the weight.Lee et al. 2003FIRMThis method utilizes high-resolution images and determines the location for the critical points of fish shape.Tillett and Lines 2004n-tupleThe estimation accuracy was low for live fish images due to poorer imaging conditions and larger fish population density.Chambah et. al. 2004ACEThis method depends on the color features that need lightness constancy and color constancy to extract visual information from the environment efficaciously.Lin et al., 2005 populate Pattern ClassifierThis method needs some critical point of the fish shape.Erikson et al. 2005Bayesian Filtering TechniqueThis method considers only counting the fish without looking into its type. Furthermore, the fish may be having varying in number of the parameters.Lee et al. 2008Several Shape DescriptorsThe main difficulty of this method is that landmark points sometimes cannot be located very accurately. Moreover, it needs a high tonus image for analysis.1.3 form Segmentation TechniquesBasically, there are different techniques that would serve well to solve the image segmentation problems. Therefore, Jeon et al., (2006) categorized these techniques into, thresholding approaches, contour approaches, region approaches, lot approaches and other optimization approaches using a Bayesian framework, neural net workings. Moreover, the lot techniques can be categorized into two general groups partitional and hierarchical foregather algorithms. Furthermore, partitional clomping algorithms such as K-means and EM bunch are widely used in many applications such as data mining, compression, image segmentation and machine learning (Coleman Andrews 1979 Carpineto Romano 1996 Jain et al., 1999 Zhang 2002a Omran et al., 2006). Therefore, this research will focus on the literature review relates with image segmentation techniques to segment fish of underwater images by using k-means algorithm and background subtraction approaches.1.3.1 K-Means algorithm for Image SegmentationIn general, the tired K-means clustering algorithm is busy in order to cluster a prone dataset into k groups. Therefore, the standard K-means algorithm consists of four steps Initialization, Classification, Centroid computation and Convergence condition. Moreover, several methods attempt to improve the standard K-means algorithm related to several aspects associated to each of the algorithm steps. Furthermore, regarding the computational of the algorithm the steps that need more improvements are low-level formatting and converging condition (Amir 2007 Joaqun et al., 2007). Therefore, the following sections will be centre on this step in order to represent and address the review for this step.1.3.1.1 The Initialization Step of K-Means AlgorithmBasically, the earliest reference to initialize the K-means algorithm was by Forgy in 1965 that choose points randomly and used as the ejaculates. Therefore, MacQueen, introduced to determine a set of cluster seeds by using an online learning dodging ( MacQueen 1967 Stephen 2007). However, this method can be choosing the point heartfelt a cluster centre or outlying point. Moreover, relieveing the numerations is the extendd time interpreted to beat a solution.The approach in order to divide the dataset to classes without prior knowledge of classes is required. Therefore, Tou Gonzales (1974) suggested the Simple Cluster Seeking (SCS) method by compute the distance between the first instance in the database and the next point in the database, if it is greater than some threshold then select it as the second seed, otherwise move to the next instance in the database and repeat until K seeds are chosen. However, this method depends on the value of threshold, the order of pattern vectors to be processed and repeating the runs is the increased time taken to distort the seeds chosen.For optimal partition of dataset which can achieve better variation grading than standard. Therefore, Linde et al., (1980) proposed a binary Splitti ng (BS) method, based on the first run for K = 1, Then take apart into two clusters until convergence is scopeed and the cycle of split and converge is repeated until a fixed number of clusters is reached, or until each cluster contains only one point. However, this method increased the computational complexness by split and the algorithm must be run again. reliable initial seeds for clustering algorithm are significant in order to rapidly converge to the global optimal structure. Therefore, Kaufman Rousseeuw (1990) suggested selecting the first seed as the most centrally located instance, then the next seed selected based on the greatest reduction in the distortion and continue until K seeds are chosen. However, this method needs more computation in choosing each seed.In order to select the optimal seed artificial science (AI) is used. Therefore, Babu Murty (1993) and Jain et al., (1996) proposed a method by using familial algorithms based on the various seed selections as pop ulation, and then the fitness of each seed selection is assessed by running the K-means algorithm until convergence and then calculating the Distortion value, in order to select of near optimal seed. However, this method should be run K-means for each solution of each generation. Moreover, a genetic algorithms result depends on the choice of population size, and crosswalk and mutation probabilities.Enhancement approach in order to improve the clustering quality and overcome computational complexity is required. Therefore, Huang Harris (1993) stated the Direct front Binary Splitting (DSBS) method, based on Principle Component Analysis (PCA), in order to enhance splitting step in Binary Splitting algorithm. However, this method withal required more computational to reach k seeds chosen.Calculating the distance between all points of dataset in order to select the seed is used. Therefore, Katsavounidis et al. (1994) proposed the algorithm as the KKZ algorithm based on rather one on the edge of the data as the first seed. Then, chosen the second seed based on the point which is utmost(a) from the first seed. Moreover, choosing the furthest point from its nearest seed is repeated until K seeds are chosen. However, this method translucent pitfall from any noise in the data as preferably seed.In order to increase the belt along of the algorithm based on divide the whole input champaign into subspaces is required. Therefore, Daoud Roberts (1996) proposed approach to divide the whole input domain into two disassociate volumes, and then this subspace is assumed that the points are randomly distributed and that the seeds will be fixed on a regular grid. However, this methods refers at the end into randomly choose.The mean of the any dataset is important value in order to estimate the seed depends on it. Therefore, Thiesson et al., (1997) suggested approach to calculate the mean of the entire dataset based on randomly running time of the algorithm to produce the K seeds. However, this method uses the random way to repeat the steps until reach the desirable clusters.In order to find better clustering initialization of k-means algorithm, Forgys method is used. Therefore, Bradley Fayyad (1998) presented a technique that begins by randomly breaking the data into 10, or so, subsets. Then it performs a K-means clustering on each of the ten subsets, all startle at the same set of initial seeds, which are chosen using Forgys method. However, this method needs to determine the size of the subset and used the same initial seed for each subset.A way of reducing the time complexity of initialization for k-means algorithm counting is to use structures corresponding k-d trees. Therefore, Likas et al., (2003) stated a global K-means algorithm which aims to gradually increase the number of seeds until K is found, by using the kd-tree to create K buckets and use the centroids of each bucket as seeds. However, this method needs to test the results to reach the best number of clusters.The performance of iterative clustering algorithms depends highly on initial cluster centers. Therefore, Mitra et al., (2002) and caravansary Ahmad (2004) proposed a Cluster Centre Initialization Method (CCIA) based on the Density-based Multi Scale Data Condensation (DBMSDC) by estimating the density of the dataset at a point, and then sorting the points according to their density and examining each of the attributes individually to extract a list of possible seed locations. The process is repeated until a desired number of points remain. However, this method depends on other approach to reach the desired seeds, which lead to more computation complexity.On the other read, in order to reduce the time complexity of initialization for k-means algorithm calculation is to use structures like k-d trees. Therefore, Stephen Conor (2007) presented a technique for initializing the K-means algorithm based on incorporate kd-trees in order to obtain density es timates of the dataset. And then by using the distance and the density information sequentially to select K seeds. However, this method occasionally failed to provide the lowest value of distortion.Table 1.2 Critical Analysis of Relevant ApproachesAuthorAlgorithmRemarksForgy 1965 and MacQueen 1967Random initial K-meansThis method can be choosing the point near a cluster centre or outlying point. Moreover, repeating the runs is the increased time taken to obtain a solution.Tou and Gonzales 1974SCSThis method depends on the value of threshold, the order of pattern vectors to be processed and repeating the runs is the increased time taken to reach the seeds chosen.Linde et al., 1980BSThis method increased the computational complexity by split and the algorithm must be run again.Kaufman and Rousseeuw 1990Selecting the first seed.This method needs more computation in choosing each seed.Babu and Murty 1993GAThis method should be run K-means for each solution of each generation. Moreover, a genetic algorithms result depends on the choice of population size, and crossover and mutation probabilities.Huang and Harris 1993DSBSThis method also required more computational to reach k seeds chosen.Katsavounidis et al. 1994KKZThis method obvious pitfall from any noise in the data as preferably seed.Daoud and Roberts 1996two disjoint volumesThis methods refers at the end into randomly choose.Thiesson et al. 1997the mean of datasetThis method uses the random way to repeat the steps until reach the desirable clusters.Bradley and Fayyad 1998randomly breaking techniqueThis method needs to determine the size of subset and the same initial seed for each subset.Likas et al. 2003Global K-meansThis method needs to test the results to reach the best number of clusters.Khan and Ahmad 2004CCIAThis method depends on other approach to reach the desired seeds, which lead to more computation complexity.Stephen and Conor 2007kd-treesThis method occasionally failed to provide the lowest value o f distortion.1.3.2 screen background Subtraction for Image SegmentationThe basic approach for automatic object detection and segmentation methods is the background subtraction. Moreover, it is a commonly used class of techniques for segmenting out objects of a scene for different applications. Therefore, Wren et al., (1997) proposed running Gaussian Average based on ideally fitting a Gaussian probability density function on the in conclusion n picture elements values in order to model the background independently at each pel location. Moreover, to increase the speed the standard deviation is computed. Therefore, the advantage of the running average is given by the low memory requirement sort of of the buffer with the last n pixel values are used. However, the empirical weight as a tradeoff between stability and quick update is lots chosen.The detection of objects is usually approached by background subtraction based on multi-valued background. Therefore, Stauffer Grimson (1999 ) proposed the multi-valued background model in order to account the foreground and the background values. Moreover, the probability of observing a certain pixel value at specific time by means of a mixture of Gaussians is described. However, this method needs assigning the new observed pixel value to the best matching distribution and estimating the updated model parameters.Density estimators can be a valuable component in an application like in the use of object tracking. Therefore, Elgammal et al. (2000) proposed a non-parametric model based on Kernel Density Estimation (KDE) by using the last n background values, in order to model the background distribution. Moreover, the sum of Gaussian kernels centered as one sample data by the most recent n background values as background is given. However, double-dyed(a) model estimation also requires the estimation of summation of Gaussian kernels.The eigen-decomposition methods are computationally demanding by involving the computation of each eigenvector and corresponding eigenvalues. Therefore, Oliver et al., (2000) proposed eigen backgrounds approach based on eigenvalues decomposition by using the whole image instead of blocks of image. Moreover, this method can be improving its efficiency, but depend on the images used for the training set. However, this method not explicitly specified what images should be part of the initial sample, and whether and how such a model should be updated over time.In order to generate and select of a plurality of blase pixel samples derived from incoming image, the temporal median(prenominal) filter is used. Therefore, Lo Velastin (2001) proposed temporal median filter based on the median value of the last n frames as the background model. Moreover, Cucchiara et al. (2003) developed the temporal median filter by computing the last n frames, sub-sampled frames and the time of the last computed median value in order to compute the median on a particular set of values. However, the disadvantage of the temporal median filter approach, the computation by a buffer with the recent pixel values is required. Moreover, the median filter does not provide a deviation measure for adapting the subtraction threshold.The information of the difference frames is accumulated, in order to construct a reliable background image. Therefore, Seki et al., (2003) proposed the background subtraction based on co-occurrence of image variations. Moreover, it works on blocks of N x N pixels treated as an N2 component vector, instead of working at pixel resolution. However, this method offers good accuracy against reasonable time and memory complexity. Furthermore, a certain update rate would be needed to cope with more extended illumination changes.Background modeling of a moving object requires sequential density estimatio