Data Cleaning

Data quality is one of the most important problems in data management, since dirty data often leads to inaccurate data analytics results and incorrect business decisions. Poor data across businesses and the U.S. government are reported to cost trillions of dollars a year. Multiple surveys show that dirty data is the most common barrier faced by data scientists. Not surprisingly, developing effective and efficient data cleaning solutions is challenging and is rife with deep theoretical and engineering problems. This book is about data cleaning, which is used to refer to all kinds of tasks and activities to detect and repair errors in the data. Rather than focus on a particular data cleaning task, we give an overview of the end-to-end data cleaning process, describing various error detection and repair methods, and attempt to anchor these proposals with multiple taxonomies and views. Specifically, we cover four of the most common and important data cleaning tasks, namely, outlier detection, data transformation, error repair (including imputing missing values), and data deduplication. Furthermore, due to the increasing popularity and applicability of machine learning techniques, we include a chapter that specifically explores how machine learning techniques are used for data cleaning, and how data cleaning is used to improve machine learning models. This book is intended to serve as a useful reference for researchers and practitioners who are interested in the area of data quality and data cleaning. It can also be used as a textbook for a graduate course. Although we aim at covering state-of-the-art algorithms and techniques, we recognize that data cleaning is still an active field of research and therefore provide future directions of research whenever appropriate.

Computers & Technology

Ilyas, Ihab F.

Chu, Xu

Networking & Cloud Computing

Morgan Claypool

Circuits, Packets, and Protocols: Entrepreneurs and Computer Communications, 1968-1988 (ACM Books)

Review\nA marvelous and 
personal exploration of a poorly documented period in the history of data 
communication! I lived through it and re-lived it in these interviews and 
narrative.--Vint Cerf, Internet Pioneer\nCircuits, Packets, 
& Protocols is full of revelations for me even though I was there. Never 
had it explained so clearly how my distributed computing strategy was the wrong 
one for 3Com in the 1980s.--Bob Metcalfe, Ethernet Inventor\nCircuits, Packets, 
& Protocols is not all about "winners" but includes the story of "losers" 
as well, and what can be learned from failures as well as successes. If you 
wonder whether there was a one-time confluence of events that brought us to the 
Digital Age, or a pattern we can learn from and pursue, this book will help you 
decide.--Elizabeth (Jake) Feinler\nThe key technologies 
that brought us our modern networked society--routers, packet switching, 
multiplexers, Internet protocols--were all invented by people in the short 
period between 1968 and 1988. James Pelkey interviewed these people at that 
time and recorded their stories. This book is the result: a detailed and 
up-close personal history of a world being born. Fascinating.--W. Brian Arthur\nThe Internet didn't 
happen overnight. It was the product of a set of quiet and diverse engineering 
efforts that took place over two decades long before the Internet became 
America's digital Main St. Circuits, Packets, & Protocols tells that 
story.--John Markoff\nCircuits, Packets, and Protocols tells the story of the engineers, entrepreneurs, investors, and visionaries who laid the groundwork and built the foundations of the Internet. 
In the late 1960s, two American corporate behemoths were poised to dominate the rapidly converging industries of computing and communications--the computer giant, IBM, and the regulated telecommunications monopoly, AT&T. But in 1968, a key ruling by the Federal Communications Commission gave small businesses a doorway into an emerging market for communication devices that could transmit computer data over telephone lines. In the two decades that followed, an industry of networking technology emerged that would impact human history in profound and unfathomable ways. Circuits, Packets, and Protocols is a groundbreaking study of the men and women in the engineering labs, board rooms, and regulatory agencies whose decisions determined the evolution of our modern digital communication networks. 
Unlike histories that glorify the dominant players with the benefit of hindsight, this is a history of a pivotal era as it happened. Drawing on more than 80 interviews recorded in 1988, the book features insights from now-famous individuals such as Paul Baran, JCR Licklider, Vint Cerf, Louis Pouzin, and Robert Metcalfe. Inspired by innovations from government-sponsored Cold War defense projects and the birth of the modern venture capital industry, these trailblazers and many others built the technologies and companies that became essential building blocks in the development of today's Internet. Many of the companies and products failed, even while they helped propel the industry forward at breakneck speed. Equal parts academic history and thrilling startup drama, Circuits, Packets, and Protocols gives the reader a vivid picture of what it was like to take part in one of the most exciting periods of technological advance in our time.

Circuits, Packets, and Protocols: Entrepreneurs and Computer Communications, 1968-1988 (Association for Computing Machinery)

Russell, Andrew L.

Pelkey, James L

Robbins, Loring G

This monograph presents the timed input/output automaton (TIOA) modeling framework, a basic mathematical framework to support description and analysis of timed (computing) systems. Timed systems are systems in which desirable correctness or performance properties of the system depend on the timing of events, not just on the order of their occurrence. Timed systems are employed in a wide range of domains including communications, embedded systems, real-time operating systems, and automated control. Many applications involving timed systems have strong safety, reliability, and predictability requirements, which makes it important to have methods for systematic design of systems and rigorous analysis of timing-dependent behavior. An important feature of the TIOA framework is its support for decomposing timed system descriptions. In particular, the framework includes a notion of external behavior for a TIOA, which captures its discrete interactions with its environment. The framework also defines what it means for one TIOA to implement another, based on an inclusion relationship between their external behavior sets, and defines notions of simulations, which provide sufficient conditions for demonstrating implementation relationships. The framework includes a composition operation for TIOAs, which respects external behavior, and a notion of receptiveness, which implies that a TIOA does not block the passage of time.

The Theory of Timed I/O Automata (Synthesis Lectures in Computer Science)

Nancy Lynch

Dilsun K. Kaynar

Roberto Segala

Frits Vaandrager

Computer Science

Engineering Ethics: Peace, Justice, and the Earth offers a new ethical foundation for the engineering profession. Modern engineering codes of ethics have primarily been developed using a Utilitarian approach. This book adopts a morally deep world view from environmental ethics as the basis for engineering practice. The fundamental canon of the new code of ethics is the following: Engineers, in the fulfillment of their professional duties, shall hold paramount the safety, health and welfare of the identified integral community. The key difference between the new code and existing codes is in the inclusion of an identified integral community. Several case studies are examined in light of the new code including the development of new tools for Mexican farmers, the design and fabrication of devices for the physically challenged, the mechanization of grape-picking in California and the development of transportations systems for the tourist industry in Churchill, Ontario, Canada. Using the new ethical code, a design methodology is developed based on the implicit notion of promoting justice and peace and reducing suffering. Implications of these developments for engineering education are also explored with a new paradigm for engineering education based upon the Integral Model. The present work is intended for practicing engineers and engineering educators as well as ethicists and philosophers.

Engineering Ethics: Peace, Justice, and the Earth

Science & Math

Catalano, George D.

Technology

This book presents the reader, whether an electrical engineering student in power electronics or a design engineer, some typical power converter control problems and their basic digital solutions, based on the most widespread digital control techniques. The presentation is focused on different applications of the same power converter topology, the half-bridge voltage source inverter, considered both in its single- and three-phase implementation. This is chosen as the case study because, besides being simple and well known, it allows the discussion of a significant spectrum of the more frequently encountered digital control applications in power electronics, from digital pulse width modulation (DPWM) and space vector modulation (SVM), to inverter output current and voltage control. The book aims to serve two purposes: to give a basic, introductory knowledge of the digital control techniques applied to power converters, and to raise the interest for discrete time control theory, stimulating new developments in its application to switching power converters.

Digital Control in Power Electronics (Synthesis Lectures on Power Electronics, 2)

Engineering & Transportation

Buso, Simone

Mattavelli, Paolo

Engineering

Quantum computationmay seem to be a topic for science fiction, but small quantum computers have existed for several years and larger machines are on the drawing table. These efforts have been fueled by a tantalizing property: while conventional computers employ a binary representation that allows computational power to scale linearly with resources at best, quantum computations employ quantum phenomena that can interact to allow computational power that is exponential in the number of quantum bits in the system. Quantum devices rely on the ability to control and manipulate binary data stored in the phase information of quantum wave functions that describe the electronic states of individual atoms or the polarization states of photons. While existing quantum technologies are in their infancy, we shall see that it is not too early to consider scalability and reliability. In fact, such considerations are a critical link in the development chain of viable device technologies capable of orchestrating reliable control of tens of millions quantum bits in a large-scale system. The goal of this lecture is to provide architectural abstractions common to potential technologies and explore the systemslevel challenges in achieving scalable, fault-tolerant quantum computation. The central premise of the lecture is directed at quantum computation (QC) architectural issues. We stress the fact that the basic tenet of large-scale quantum computing is reliability through system balance: the need to protect and control the quantum information just long enough for the algorithm to complete execution. To architectQCsystems, onemust understand what it takes to design and model a balanced, fault-tolerant quantum architecture just as the concept of balance drives conventional architectural design. For example, the register file depth in classical computers is matched to the number of functional units, the memory bandwidth to the cache miss rate, or the interconnect bandwidth matched to the compute power of each element of a multiprocessor. We provide an engineering-oriented introduction to quantum computation and provide an architectural case study based upon experimental data and future projection for ion-trap technology.We apply the concept of balance to the design of a quantum computer, creating an architecture model that balances both quantum and classical resources in terms of exploitable parallelism in quantum applications. From this framework, we also discuss the many open issues remaining in designing systems to perform quantum computation.

Quantum Computing for Computer Architects

Tzvetan S. Metodi

Frederic T. Chong

Computational Photography (Synthesis Lectures on Computer Graphics and Animation)

Raskar, Ramesh

A medical device is an apparatus that uses engineering and scientific principles to interface to physiology and diagnose or treat a disease. In this Lecture, we specifically consider thosemedical devices that are computer based, and are therefore referred to as medical instruments. Further, the medical instruments we discuss are those that incorporate system theory into their designs. We divide these types of instruments into those that provide continuous observation and those that provide a single snapshot of health information. These instruments are termed patient monitoring devices and diagnostic devices, respectively.Within this Lecture, we highlight some of the common system theory techniques that are part of the toolkit of medical device engineers in industry. These techniques include the pseudorandom binary sequence, adaptive filtering, wavelet transforms, the autoregressive moving average model with exogenous input, artificial neural networks, fuzzy models, and fuzzy control. Because the clinical usage requirements for patient monitoring and diagnostic devices are so high, system theory is the preferred substitute for heuristic, empirical processing during noise artifact minimization and classification.

A Biosystems Approach to Industrial Patient Monitoring and Diagnostic Devices (Synthesis Lectures on Biomedical Engineering)

Baura, Gail

As computation continues to move into the cloud, the computing platform of interest no longer resembles a pizza box or a refrigerator, but a warehouse full of computers. These new large datacenters are quite different from traditional hosting facilities of earlier times and cannot be viewed simply as a collection of co-located servers. Large portions of the hardware and software resources in these facilities must work in concert to efficiently deliver good levels of Internet service performance, something that can only be achieved by a holistic approach to their design and deployment. In other words, we must treat the datacenter itself as one massive warehouse-scale computer (WSC). We describe the architecture of WSCs, the main factors influencing their design, operation, and cost structure, and the characteristics of their software base. We hope it will be useful to architects and programmers of today's WSCs, as well as those of future many-core platforms which may one day implement the equivalent of today's WSCs on a single board. Table of Contents: Introduction / Workloads and Software Infrastructure / Hardware Building Blocks / Datacenter Basics / Energy and Power Efficiency / Modeling Costs / Dealing with Failures and Repairs / Closing Remarks

The Data Center as a Computer: An Introduction to the Design of Warehouse- Scale Machines (Synthesis Lectures on Computer Architecture)

Urs Hoelzle

Luiz Andre Barroso

It is well-known that speckle is a multiplicative noise that degrades image quality and the visual evaluation in ultrasound imaging. This necessitates the need for robust despeckling techniques for both routine clinical practice and teleconsultation. The goal for this book is to introduce the theoretical background (equations), the algorithmic steps, and the MATLAB™ code for the following group of despeckle filters: linear filtering, nonlinear filtering, anisotropic diffusion filtering and wavelet filtering. The book proposes a comparative evaluation framework of these despeckle filters based on texture analysis, image quality evaluation metrics, and visual evaluation by medical experts, in the assessment of cardiovascular ultrasound images recorded from the carotid artery. The results of our work presented in this book, suggest that the linear local statistics filter DsFlsmv, gave the best performance, followed by the nonlinear geometric filter DsFgf4d, and the linear homogeneous mask area filter DsFlsminsc. These filters improved the class separation between the asymptomatic and the symptomatic classes (of ultrasound images recorded from the carotid artery for the assessment of stroke) based on the statistics of the extracted texture features, gave only a marginal improvement in the classification success rate, and improved the visual assessment carried out by two medical experts. A despeckle filtering analysis and evaluation framework is proposed for selecting the most appropriate filter or filters for the images under investigation. These filters can be further developed and evaluated at a larger scale and in clinical practice in the automated image and video segmentation, texture analysis, and classification not only for medical ultrasound but for other modalities as well, such as synthetic aperture radar (SAR) images. Table of Contents: Introduction to Ultrasound Imaging / Despeckle Filtering Algorithms / Evaluation Methodology / Applications of Despeckle Filtering in Ultrasound Imaging / Comparison and Discussion of Despeckle Filtering Algorithms / Summary and Future Directions

Despeckle Filtering Algorithims and Software for Ultrasound Imaging

Loizou, Christos P.

Pattichis, Constantinos S.

Programming

See the best price to sell, buy or rent books by the Morgan Claypool publisher. BookScouter helps to compare book prices from 25+ online bookstores and 30+ buyback vendors with a single search.

Books by Morgan Claypool