Data Cleaning

Data quality is one of the most important problems in data management, since dirty data often leads to inaccurate data analytics results and incorrect business decisions. Poor data across businesses and the U.S. government are reported to cost trillions of dollars a year. Multiple surveys show that dirty data is the most common barrier faced by data scientists. Not surprisingly, developing effective and efficient data cleaning solutions is challenging and is rife with deep theoretical and engineering problems. This book is about data cleaning, which is used to refer to all kinds of tasks and activities to detect and repair errors in the data. Rather than focus on a particular data cleaning task, we give an overview of the end-to-end data cleaning process, describing various error detection and repair methods, and attempt to anchor these proposals with multiple taxonomies and views. Specifically, we cover four of the most common and important data cleaning tasks, namely, outlier detection, data transformation, error repair (including imputing missing values), and data deduplication. Furthermore, due to the increasing popularity and applicability of machine learning techniques, we include a chapter that specifically explores how machine learning techniques are used for data cleaning, and how data cleaning is used to improve machine learning models. This book is intended to serve as a useful reference for researchers and practitioners who are interested in the area of data quality and data cleaning. It can also be used as a textbook for a graduate course. Although we aim at covering state-of-the-art algorithms and techniques, we recognize that data cleaning is still an active field of research and therefore provide future directions of research whenever appropriate.

Computers & Technology

Ilyas, Ihab F.

Chu, Xu

Networking & Cloud Computing

Morgan Claypool

This monograph presents the timed input/output automaton (TIOA) modeling framework, a basic mathematical framework to support description and analysis of timed (computing) systems. Timed systems are systems in which desirable correctness or performance properties of the system depend on the timing of events, not just on the order of their occurrence. Timed systems are employed in a wide range of domains including communications, embedded systems, real-time operating systems, and automated control. Many applications involving timed systems have strong safety, reliability, and predictability requirements, which makes it important to have methods for systematic design of systems and rigorous analysis of timing-dependent behavior. An important feature of the TIOA framework is its support for decomposing timed system descriptions. In particular, the framework includes a notion of external behavior for a TIOA, which captures its discrete interactions with its environment. The framework also defines what it means for one TIOA to implement another, based on an inclusion relationship between their external behavior sets, and defines notions of simulations, which provide sufficient conditions for demonstrating implementation relationships. The framework includes a composition operation for TIOAs, which respects external behavior, and a notion of receptiveness, which implies that a TIOA does not block the passage of time.

The Theory of Timed I/O Automata (Synthesis Lectures in Computer Science)

Nancy Lynch

Dilsun K. Kaynar

Roberto Segala

Frits Vaandrager

Computer Science

Engineering Ethics: Peace, Justice, and the Earth offers a new ethical foundation for the engineering profession. Modern engineering codes of ethics have primarily been developed using a Utilitarian approach. This book adopts a morally deep world view from environmental ethics as the basis for engineering practice. The fundamental canon of the new code of ethics is the following: Engineers, in the fulfillment of their professional duties, shall hold paramount the safety, health and welfare of the identified integral community. The key difference between the new code and existing codes is in the inclusion of an identified integral community. Several case studies are examined in light of the new code including the development of new tools for Mexican farmers, the design and fabrication of devices for the physically challenged, the mechanization of grape-picking in California and the development of transportations systems for the tourist industry in Churchill, Ontario, Canada. Using the new ethical code, a design methodology is developed based on the implicit notion of promoting justice and peace and reducing suffering. Implications of these developments for engineering education are also explored with a new paradigm for engineering education based upon the Integral Model. The present work is intended for practicing engineers and engineering educators as well as ethicists and philosophers.

Engineering Ethics: Peace, Justice, and the Earth

Science & Math

Catalano, George D.

Technology

This book presents the reader, whether an electrical engineering student in power electronics or a design engineer, some typical power converter control problems and their basic digital solutions, based on the most widespread digital control techniques. The presentation is focused on different applications of the same power converter topology, the half-bridge voltage source inverter, considered both in its single- and three-phase implementation. This is chosen as the case study because, besides being simple and well known, it allows the discussion of a significant spectrum of the more frequently encountered digital control applications in power electronics, from digital pulse width modulation (DPWM) and space vector modulation (SVM), to inverter output current and voltage control. The book aims to serve two purposes: to give a basic, introductory knowledge of the digital control techniques applied to power converters, and to raise the interest for discrete time control theory, stimulating new developments in its application to switching power converters.

Digital Control in Power Electronics (Synthesis Lectures on Power Electronics, 2)

Engineering & Transportation

Buso, Simone

Mattavelli, Paolo

Engineering

Quantum computationmay seem to be a topic for science fiction, but small quantum computers have existed for several years and larger machines are on the drawing table. These efforts have been fueled by a tantalizing property: while conventional computers employ a binary representation that allows computational power to scale linearly with resources at best, quantum computations employ quantum phenomena that can interact to allow computational power that is exponential in the number of quantum bits in the system. Quantum devices rely on the ability to control and manipulate binary data stored in the phase information of quantum wave functions that describe the electronic states of individual atoms or the polarization states of photons. While existing quantum technologies are in their infancy, we shall see that it is not too early to consider scalability and reliability. In fact, such considerations are a critical link in the development chain of viable device technologies capable of orchestrating reliable control of tens of millions quantum bits in a large-scale system. The goal of this lecture is to provide architectural abstractions common to potential technologies and explore the systemslevel challenges in achieving scalable, fault-tolerant quantum computation. The central premise of the lecture is directed at quantum computation (QC) architectural issues. We stress the fact that the basic tenet of large-scale quantum computing is reliability through system balance: the need to protect and control the quantum information just long enough for the algorithm to complete execution. To architectQCsystems, onemust understand what it takes to design and model a balanced, fault-tolerant quantum architecture just as the concept of balance drives conventional architectural design. For example, the register file depth in classical computers is matched to the number of functional units, the memory bandwidth to the cache miss rate, or the interconnect bandwidth matched to the compute power of each element of a multiprocessor. We provide an engineering-oriented introduction to quantum computation and provide an architectural case study based upon experimental data and future projection for ion-trap technology.We apply the concept of balance to the design of a quantum computer, creating an architecture model that balances both quantum and classical resources in terms of exploitable parallelism in quantum applications. From this framework, we also discuss the many open issues remaining in designing systems to perform quantum computation.

Quantum Computing for Computer Architects

Tzvetan S. Metodi

Frederic T. Chong

Computational Photography (Synthesis Lectures on Computer Graphics and Animation)

Raskar, Ramesh

A medical device is an apparatus that uses engineering and scientific principles to interface to physiology and diagnose or treat a disease. In this Lecture, we specifically consider thosemedical devices that are computer based, and are therefore referred to as medical instruments. Further, the medical instruments we discuss are those that incorporate system theory into their designs. We divide these types of instruments into those that provide continuous observation and those that provide a single snapshot of health information. These instruments are termed patient monitoring devices and diagnostic devices, respectively.Within this Lecture, we highlight some of the common system theory techniques that are part of the toolkit of medical device engineers in industry. These techniques include the pseudorandom binary sequence, adaptive filtering, wavelet transforms, the autoregressive moving average model with exogenous input, artificial neural networks, fuzzy models, and fuzzy control. Because the clinical usage requirements for patient monitoring and diagnostic devices are so high, system theory is the preferred substitute for heuristic, empirical processing during noise artifact minimization and classification.

A Biosystems Approach to Industrial Patient Monitoring and Diagnostic Devices (Synthesis Lectures on Biomedical Engineering)

Baura, Gail

As computation continues to move into the cloud, the computing platform of interest no longer resembles a pizza box or a refrigerator, but a warehouse full of computers. These new large datacenters are quite different from traditional hosting facilities of earlier times and cannot be viewed simply as a collection of co-located servers. Large portions of the hardware and software resources in these facilities must work in concert to efficiently deliver good levels of Internet service performance, something that can only be achieved by a holistic approach to their design and deployment. In other words, we must treat the datacenter itself as one massive warehouse-scale computer (WSC). We describe the architecture of WSCs, the main factors influencing their design, operation, and cost structure, and the characteristics of their software base. We hope it will be useful to architects and programmers of today's WSCs, as well as those of future many-core platforms which may one day implement the equivalent of today's WSCs on a single board. Table of Contents: Introduction / Workloads and Software Infrastructure / Hardware Building Blocks / Datacenter Basics / Energy and Power Efficiency / Modeling Costs / Dealing with Failures and Repairs / Closing Remarks

The Data Center as a Computer: An Introduction to the Design of Warehouse- Scale Machines (Synthesis Lectures on Computer Architecture)

Urs Hoelzle

Luiz Andre Barroso

It is well-known that speckle is a multiplicative noise that degrades image quality and the visual evaluation in ultrasound imaging. This necessitates the need for robust despeckling techniques for both routine clinical practice and teleconsultation. The goal for this book is to introduce the theoretical background (equations), the algorithmic steps, and the MATLAB™ code for the following group of despeckle filters: linear filtering, nonlinear filtering, anisotropic diffusion filtering and wavelet filtering. The book proposes a comparative evaluation framework of these despeckle filters based on texture analysis, image quality evaluation metrics, and visual evaluation by medical experts, in the assessment of cardiovascular ultrasound images recorded from the carotid artery. The results of our work presented in this book, suggest that the linear local statistics filter DsFlsmv, gave the best performance, followed by the nonlinear geometric filter DsFgf4d, and the linear homogeneous mask area filter DsFlsminsc. These filters improved the class separation between the asymptomatic and the symptomatic classes (of ultrasound images recorded from the carotid artery for the assessment of stroke) based on the statistics of the extracted texture features, gave only a marginal improvement in the classification success rate, and improved the visual assessment carried out by two medical experts. A despeckle filtering analysis and evaluation framework is proposed for selecting the most appropriate filter or filters for the images under investigation. These filters can be further developed and evaluated at a larger scale and in clinical practice in the automated image and video segmentation, texture analysis, and classification not only for medical ultrasound but for other modalities as well, such as synthetic aperture radar (SAR) images. Table of Contents: Introduction to Ultrasound Imaging / Despeckle Filtering Algorithms / Evaluation Methodology / Applications of Despeckle Filtering in Ultrasound Imaging / Comparison and Discussion of Despeckle Filtering Algorithms / Summary and Future Directions

Despeckle Filtering Algorithims and Software for Ultrasound Imaging

Loizou, Christos P.

Pattichis, Constantinos S.

Programming

This book represents the first in a two-volume set on biological rhythms. This volume focuses on supporting the claim that biological rhythms are universal and essential characteristics of living organisms, critical for proper functioning of any living system.  The author begins by examining the potential reasons for the evolution of biological rhythms: (1) the need for complex, goal-oriented devices to control the timing of their activities; (2) the inherent tendency of feedback control systems to oscillate; and (3) the existence of stable and powerful geophysical cycles to which all organisms must adapt. To investigate the second reason, the author enlists the help of biomedical engineering students to develop mathematical models of various biological systems. One such model involves a typical endocrine feedback system. By adjusting various model parameters, it was found that creating a oscillation in any component of the model generated a rhythmic cascade that made the entire system oscillate. This same approach was used to show how daily light/dark cycles could cascade rhythmic patterns throughout ecosystems and within organisms.  Following up on these results, the author discusses how the twin requirements of internal synchronization (precise temporal order necessary for the proper functioning of organisms as complex, goal-oriented devices) and external synchronization (aligning organisms' behavior and physiology with geophysical cycles) supported the evolution of biological clocks. The author then investigates the clock systems that evolved using both conceptual and mathematical models, with the assistance of Dr. Bahrad Sokhansanj, who contributes a chapter on mathematical formulations and models of rhythmic phenomena. With the ubiquity of biological rhythms established, the author suggests a new classification system: the F4LM approach (Function; Frequency; waveForm; Flexibility; Level of biological system expressing rhythms; and Mode of rhythm generation) to investigate biological rhythms. This approach is first used on the more familiar cardiac cycle and then on neural rhythms as exemplified and measured by the electroencephalogram. During the process of investigating neural cycles, the author finds yet another reason for the evolution of biological rhythms: physical constraints, such as those imposed upon long distance neural signaling. In addition, a common theme emerges of a select number of autorhythmic biological oscillators imposing coherent rhythmicity on a larger network or system. During the course of the volume, the author uses a variety of observations, models, experimental results, and arguments to support the original claim of the importance and universality of biological rhythms. In Volume 2, the author will move from the establishment of the critical nature of biological rhythms to how these phenomena may be used to improve human health, well-being, and productivity. In a sense, Volume 1 focuses on the chronobio aspect of chronobioengineering while Volume 2 investigates methods of translating this knowledge into applications, the engineering aspect of chronobioengineering.  Table of Contents: Time and Time Again / Walking on Air: An Empirical Proof-of-Concept / Clock Tech, Part 1 / Clock Tech II From External to Internal Timers / Clock Tech III Rise of the CircaRhythms / The Circle Game: Mathematics, Models, and Rhythms / The Power of Circular Reasoning

Chronoengineering (Synthesis Lectures on Biomedical Engineering)

McEachron, Donald

Biological Sciences

See the best price to sell, buy or rent books by the Morgan Claypool publisher. BookScouter helps to compare book prices from 25+ online bookstores and 30+ buyback vendors with a single search.

Books by Morgan Claypool