Search
Filters
total: 886
Search results for: data processing
-
Architecture for Aggregation, Processing and Provisioning of Data from Heterogeneous Scientific Information Services
Publication -
Sampling Theory, Signal Processing, and Data Analysis
Journals -
Influence of YARN Schedulers on Power Consumption and Processing Time for Various Big Data Benchmarks
PublicationClimate change caused by human activities can influence the lives of everybody onthe planet. The environmental concerns must be taken into consideration by all fields of studyincludingICT. Green Computing aims to reduce negative effects of IT on the environment while,at the same time, maintaining all of the possible benefits it provides. Several Big Data platformslike Apache Spark orYARNhave become widely used in analytics and...
-
Processing of LiDAR and Multibeam Sonar Point Cloud Data for 3D Surface and Object Shape Reconstruction
PublicationUnorganised point cloud dataset, as a transitional data model in several applications, usually contains a considerable amount of undesirable irregularities, such as strong variability of local point density, missing data, overlapping points and noise caused by scattering characteristics of the environment. For these reasons, further processing of such data, e.g. for construction of higher order geometric models of the topography...
-
Assessing business process complexity based on textual data: Evidence from ITIL IT ticket processing
PublicationPurpose This study aims to draw the attention of business process management (BPM) research and practice to the textual data generated in the processes and the potential of meaningful insights extraction. The authors apply standard natural language processing (NLP) approaches to gain valuable knowledge in the form of business process (BP) complexity concept suggested in the study. It is built on the objective, subjective and meta-knowledge...
-
A universal IT system architecture for servicing, collecting, storing, processing and presenting data from wireless devices
PublicationIn the article we present a universal IT system architecture, which allows one to develop, based on mobile and multiplatform JAVA language, applications capable of working with many different wireless systems in an easy and effective way. Modular system architecture supports efficient data processing and enables convenient presentation of chosen parameters. Additionally, proposed IT system architecture provides easy adoption to...
-
Optimization of Data Assignment for Parallel Processing in a Hybrid Heterogeneous Environment Using Integer Linear Programming
PublicationIn the paper we investigate a practical approach to application of integer linear programming for optimization of data assignment to compute units in a multi-level heterogeneous environment with various compute devices, including CPUs, GPUs and Intel Xeon Phis. The model considers an application that processes a large number of data chunks in parallel on various compute units and takes into account computations, communication including...
-
MATCHED FILTER APPROACH FOR MICROSEISMIC SIGNAL PROCESSING OF REAL DATA FROM EAST POMERANIA SHALE GAS
PublicationThe microseismic monitoring is a method of monitoring of fracture propagation during hydraulic fracturing (HF)process. An array of several hundred geophones is placed on the surface to record little ground tremors induced by fracturing process. Filtration and summation of signals from geophones is essential to identify and locate fracturing events from underground. Authors propose a method of matched filtering, that is usually...
-
Processing of point cloud data retrieved from terrestrial laser scanning for structural modeling by Finite Element Method
PublicationFinite Element Method is one most popular contemporary method of strength analysis. The method is an advanced method for solving differential equations, based on discretization, which means that area is divided into finite elements. Each finite element has a solution of the equation approximated by specific functions and performing the actual calculations only for nodes of this division. Finite Element Method is widely used in...
-
Adaptive system for recognition of sounds indicating threats to security of people and property employing parallel processing of audio data streams
PublicationA system for recognition of threatening acoustic events employing parallel processing on a supercomputing cluster is featured. The methods for detection, parameterization and classication of acoustic events are introduced. The recognition engine is based onthreshold-based detection with adaptive threshold and Support Vector Machine classifcation. Spectral, temporal and mel-frequency descriptors are used as signal features. The...
-
Post processing and selecting data obtain with parametric sub-bottom profiler SES-2000 Standard during sounding the Gulf of Gdansk
PublicationThe main goal of the paper is to describe the results of sounding the Gulf of Gdansk seabed using a parametric sub-bottom profiler SES-2000 Standard. Quality of obtained during trials data depends inter alia on proper location of antenna to reduce influence of pitch, roll, heave and ship noise (bubbles from propeller and a hull flow, vibration from main engine and peripheral devices). Furthermore calibration of complementary units...
-
Statistical Data Pre-Processing and Time Series Incorporation for High-Efficacy Calibration of Low-Cost NO2 Sensor Using Machine Learning
PublicationAir pollution stands as a significant modern-day challenge impacting life quality, the environment, and the economy. It comprises various pollutants like gases, particulate matter, biological molecules, and more, stemming from sources such as vehicle emissions, industrial operations, agriculture, and natural events. Nitrogen dioxide (NO2), among these harmful gases, is notably prevalent in densely populated urban regions. Given...
-
Machine-learning-based precise cost-efficient NO2 sensor calibration by means of time series matching and global data pre-processing
PublicationAir pollution remains a considerable contemporary challenge affecting life quality, the environment, and economic well-being. It encompasses an array of pollutants—gases, particulate matter, biological molecules—emanating from sources such as vehicle emissions, industrial activities, agriculture, and natural occurrences. Nitrogen dioxide (NO2), a harmful gas, is particularly abundant in densely populated urban areas. Given its...
-
Cavitation based cleaner technologies for biodiesel production and processing of hydrocarbon streams: A perspective on key fundamentals, missing process data and economic feasibility – A review
PublicationThe present review emphasizes the role of hydrodynamic cavitation (HC) and acoustic cavitation in clean and green technologies for selected fuels (of hydrocarbon origins such as gasoline, naphtha, diesel, heavy oil, and crude oil) processing applications including biodiesel production. Herein, the role of cavitation reactors, their geometrical parameters, physicochemical properties of liquid media, liquid oxidants, catalyst loading,...
-
DPCTM Data Processing Centre - Task Manager (DPCTM) product
ProjectsProject realized in Department of Geoinformatics
-
Shu Ju Cai Ji Yu Chu Li/Journal of Data Acquisition and Processing
Journals -
Algorithms for processing and visualization of Critical Infrastructure security data as well as simulation and analysis of threats = Algorytmy przetwarzania i wizualizacji danych dotyczących bezpieczeństwa infrastruktur krytycznych oraz symulacji i analizy zagrożeń
PublicationRozprawa traktuje o algorytmach przetwarzania danych dotyczących różnego rodzaju zagrożeń, w szczególności wyników analiz ryzyka infrastruktur krytycznych, pozwalających na przestrzenną analizę tych danych w kontekście geograficznym za pomocą dedykowanego Systemu Informacji Przestrzennej. Prezentowane metody analizy zgrupowań Infrastruktur Krytycznych oraz propagacji ich zagrożeń wykorzystują wyniki syntetycznej analizy podatności...
-
[Chapter] 22. Application of physical modeling to study combustion process-es and flow patterns in large-scale boilers and furmaces. W: Optical me- thods and data processing in heat and fluid flow. Ed. C. Greated, J. Cos-grove, J.M. Buick. Bury St. Edmunds. London: Profess. Eng. Publ.**2002 s. 267-277, 4 rys. bibliogr. 6 poz. Zastosowanie modelowania fizycznego do badania procesów spalania pola prze- pływu w przemysłowych kotłach i piecach.
PublicationRozdział zawiera wyniki badań modelowania fizycznego dwuwymiarowego i trój-wymiarowego pola przepływu i procesów spalania w wybranych urządzeniachprzemysłowych.
-
International Symposium on 3D Data Processing Visualization and Transmission
Conferences -
[ITiT] Technologies of Spatial Data Analysis and Processing
e-Learning Courses{mlang pl} Dyscyplina: Informatyka Techniczna i Telekomunikacja Zajęcia obowiązkowe dla doktorantów II roku Prowadzący: dr hab. inż. Marcin Kulawiak Liczba godzin: 30 h Forma zajęć: wykład/seminarium {mlang} {mlang en} Discipline: Technical Informatics and Telecommunications Obligatory course for 2nd year PhD students Academic teacher: dr hab. inż. Marcin Kulawiak Total hours of training: 30 teaching hours Course...
-
Architecture and implementation of distributed data storage using Web Services, CORBA i PVM. W: Proceedings. PPAM 2003. Parallel Processing and Applied Mathematics. Fifth International Conference. Częstochowa, 7-10 September 2003. Architektura i implementacja rozproszonego zarządzania danymi używając systemów Web Services, CORBA i PVN.
PublicationProponujemy architekturę i jej implementację PVMWeb Cluster I/O przeznaczoną do rozproszonego zarządzania danymi. Dane zapisywane są w systemie Web Services z geograficznie odległych klientów lub przez wywołania CORBA z wewnątrz danego klastra co oferuje lepsze osiągi.
-
First detection of spectral resonance structures of the ionospheric Alfvén resonance in ULF/ELF magnetic field recorded at Suwałki, Poland
Publication -
“Electromagnetic ULF/ELF Fields on Earth and in Space” Conference, Warsaw, Poland, 2019. Preface
Publication -
Analysing and processing of geotagged social media
PublicationThe use of location based data analysing tools is an important part of geomarketing strategies among entrepreneurs. One of the key elements of interest is social media data shared by the users. This data is analysed both for its content and its location information, the results help to identify trends represented in the researched regions. In order to verify the possibilities of analysing and processing of geotagged social media...
-
The OptD-multi method in LiDAR processing
PublicationNew and constantly developing technology for acquiring spatial data, such as LiDAR (light detection and ranging), is a source for large volume of data. However, such amount of data is not always needed for developing the most popular LiDAR products: digital terrain model (DTM) or digital surface model. Therefore, in many cases, the number of contained points are reduced in the pre-processing stage. The degree of reduction is determined...
-
Multi-core processing system for real-time image processing in embedded computer vision applications
PublicationW artykule opisano architekturę wielordzeniowego programowalnego systemu do przetwarzania obrazów w czasie rzeczywistym. Dane obrazu są przetwarzane równocześnie przez wszystkie procesory. System umożliwia niskopoziomowe przetwarzanie obrazów,np. odejmowanie tła, wykrywanie obiektów ruchomych, transformacje geometryczne, indeksowanie wykrytych obiektów, ocena ich kształtu oraz podstawowa analiza trajektorii ruchu. Ang:This paper...
-
Implementation of DIFAR Processing in ASW Dipping Sonar
PublicationThis paper presents the implementation of the signal processing algorithm used by buoy DIFAR (Directional Frequency Analysis and Recording), that is fully operational on Polish Navy anti-submarine warfare (ASW) helicopters and ships, applied to dipping sonars for detection and tracking of submarines. The development of the DSP algorithms was a part of the modernization of sonars conducted at the Gdansk University of Technology....
-
Towards Effective Processing of Large Text Collections
PublicationIn the article we describe the approach to parallelimplementation of elementary operations for textual data categorization.In the experiments we evaluate parallel computations ofsimilarity matrices and k-means algorithm. The test datasets havebeen prepared as graphs created from Wikipedia articles relatedwith links. When we create the clustering data packages, wecompute pairs of eigenvectors and eigenvalues for visualizationsof...
-
Modelling and simulation of GPU processing in the MERPSYS environment
PublicationIn this work, we evaluate an analytical GPU performance model based on Little's law, that expresses the kernel execution time in terms of latency bound, throughput bound, and achieved occupancy. We then combine it with the results of several research papers, introduce equations for data transfer time estimation, and finally incorporate it into the MERPSYS framework, which is a general-purpose simulator for parallel and distributed...
-
Remote current measurement with FPGA digital processing
PublicationThe work presents an implementation of a modular measurement and control systemthat controls variants of mains supply of 230V electrical equipment. The system allowsto supervise power consumption in the office electronic equipment. The system detectsthe instant of the reduced power consumption by a device and makes possible itsswitch-off in order to reduce energy cost. The current is measured with integratedcurrent/voltage converters....
-
Accelerometer signal pre-processing influence on human activity recognition
PublicationA study of data pre-processing influence on accelerometer-based human activity recognition algorithms is presented. The frequency band used to filter-out the accelerometer signals and the number of accelerometers involved were considered in terms of their influence on the recognition accuracy.
-
Using wearable device for biomedical signal acquisition and processing
PublicationIn this paper we present the research conducted on synchronous measurements of biosignals. The experiment was conducted to evaluate the possibility of estimating vital signs based on eye tracking. Method: The eGlasses platform was used for acquisition of ECG, respiration rate, eye and pupil movement and blood pressure. Data were acquired in three 5 min. intervals during which a subject was performing certain tasks. The signals...
-
Evaluation of the Impact of Different Types of Uncoupling on the Processing Capacity of Hump Yards
PublicationThe paper considers the issue of evaluating the impact of different types of uncoupling to increase the processing capacity of hump yards to ensure high technical-economic indicators in the conditions of limited capital funds. Moreover it describes the mathematical formulation of the sorting slide. For the mathematical formulation, the sorting slide is taken as a surface that is uniquely projected onto a horizontal plane. Based...
-
Prediction of Processor Utilization for Real-Time Multimedia Stream Processing Tasks
PublicationUtilization of MPUs in a computing cluster node for multimedia stream processing is considered. Non-linear increase of processor utilization is described and a related class of algorithms for multimedia real-time processing tasks is defined. For such conditions, experiments measuring the processor utilization and output data loss were proposed and their results presented. A new formula for prediction of utilization was proposed...
-
Combined method of multibeam sonar signal processing and image analysis for seafloor classification
PublicationThe combined approach to seafloor characterisation was investigated. It relies on calculation of several descriptors (parameters) related to seabed type using three types of multibeam sonar data obtained during seafloor sensing: 1) the grey-level sonar images (echograms) of seabed, 2) the 3D model of the seabed surface which consists of bathymetric data, 3) the set of time domain bottom echo envelopes received in the consecutive...
-
Seafloor characterisation using multibeam sonar echo signal processing and image analysis
PublicationThe authors propose the approach to multibeam seafloor characterisation which relies on the combined, concurrent use of two different techniques of multibeam sonar data processing. The first one is based on constructing the grey-level sonar images of seabed using the echoes received in the consecutive beams. Then, the parameters describing the local region of sonar image, namely, the local standard deviation of a grey level, and...
-
Semantic technologies based method of collection, processing and sharing information along food chain
PublicationIn the paper the method of collecting, processing and sharing information along food chain is presented. Innovative features of that method result from advantages of data engineering based on semantic technologies. The source to build ontology are standards and regulations related to food production, and data collected in databases owned by food chain participants. It allows food chain information resources can be represented in...
-
DATABASE AND BIGDATA PROCESSING SYSTEM FOR ANALYSIS OF AIS MESSAGES IN THE NETBALTIC RESEARCH PROJECT
PublicationA specialized database and a software tool for graphical and numerical presentation of maritime measurement results has been designed and implemented as part of the research conducted under the netBaltic project (Internet over the Baltic Sea – the implementation of a multi-system, self-organizing broadband communications network over the sea for enhancing navigation safety through the development of e-navigation services.) The...
-
Influence of accelerometer signal pre-processing and classification method on human activity recognition
PublicationA study of data pre-processing influence on accelerometer-based human activity recognition algorithms is presented. The frequency band used to filter-out the accelerometer signals and the number of accelerometers involved were considered in terms of their influence on the recognition accuracy. In the test four methods of classification were used: support vector machine, decision trees, neural network, k-nearest neighbor.
-
An image processing approach for fatigue crack identification in cellulose acetate replicas
PublicationThe cellulose acetate replication technique is an important method for studying material fatigue. However, extracting accurate information from pictures of cellulose replicas poses challenges because of distortions and numerous artifacts. This paper presents an image processing procedure for effective fatigue crack identification in plastic replicas. The approach employs thresholding, adaptive Gaussian thresholding, and Otsu binarization...
-
BENEFITS FROM BREAKING UP WITH LINUX NATIVE PACKET PROCESSING WHILE USING INTEL DPDK LIBRARIES
PublicationThe Intel Data Plane Development Kit (DPDK) is a set of libraries and drivers for fast packet processing in Linux. It is a dedicated framework for building efficient high-speed data plane applications supporting QoS features with poll mode drivers which are supporting virtual and physical NIC’s so environment can be used to build efficient data plane applications for packet networks. The results of test on Quality of Service Metering...
-
Optimization algorithm and filtration using the adaptive TIN model at the stage of initial processing of the ALS point cloud
PublicationAirborne laser scanning (ALS) provides survey results in the form of a point cloud. The ALS point cloud is a source of data used primarily for constructing a digital terrain model (DTM). To generate a DTM, the set of ALS observations must be first subjected to the point cloud processing methodology. A standard methodology is composed of the following stages: acquisition of the ALS data, initial processing (including filtration),...
-
Model-Free Controller Tuning Based on DFT Processing: Application to Induction Motor Drives
PublicationIn this paper, we present a new approach based on discrete Fourier transform (DFT) analysis for controller tuning of the closed-loop system with unknown plant. The DFT analysis is used to process the closed-loop measurements collected online to derive the frequency response of an initial closed-loop system that does not provide a good performance. Based on the closed-loop frequency response data, we propose two methods for tuning PID...
-
Krzysztof Goczyła prof. dr hab. inż.
PeopleKrzysztof Goczyła, full professor of Gdańsk University of Technology, computer scientist, a specialist in software engineering, knowledge engineering and databases. He graduated from the Faculty of Electronics Technical University of Gdansk in 1976 with a degree in electronic engineering, specializing in automation. Since then he has been working at Gdańsk University of Technology. In 1982 he obtained a doctorate in computer science...
-
Harmony Search for Data Mining with Big Data
PublicationIn this paper, some harmony search algorithms have been proposed for data mining with big data. Three areas of big data processing have been studied to apply new metaheuristics. The first problem is related to MapReduce architecture that can be supported by a team of harmony search agents in grid infrastructure. The second dilemma involves development of harmony search in preprocessing of data series before data mining. Moreover,...
-
A Survey on the Datasets and Algorithms for Satellite Data Applications
PublicationThis survey compiles insights and describes datasets and algorithms for applications based on remote sensing. The goal of this review is twofold: datasets review for particular groups of tasks and high-level steps of data flow between satellite instruments and end applications from an implementation and development perspective. The article outlines the generalized data processing pipelines, taking into account the variations in...
-
BIG PROBLEMS WITH BIG DATA
PublicationThe article presents an overview of the most important issues related to the phenomenon called big data. The characteristics of big data concerning the data itself and the data sources are presented. Then, the big data life cycle concept is formulated. The next sections focus on two big data technologies: MapReduce for big data processing and NoSQL databases for big data storage.
-
Paweł Czarnul dr hab. inż.
PeoplePaweł Czarnul obtained a D.Sc. degree in computer science in 2015, a Ph.D. in computer science granted by a council at the Faculty of Electronics, Telecommunications and Informatics, Gdansk University of Technology in 2003. His research interests include:parallel and distributed processing including clusters, accelerators, coprocessors; distributed information systems; architectures of distributed systems; programming mobile devices....
-
Distributed Detection of Selected Features in Data Streams Using Grid-class Systems
PublicationThis chapter describes basic methodology of distributed digital signal processing. A choice of distributed methods of detection of selected features in data streams using grid-class systems is discussed. Problems related to distribution of data for processing are addressed. A mitigating method for data distribution and result merging is described.
-
Manufacturing Data Analysis in Internet of Things/Internet of Data (IoT/IoD) Scenario
PublicationComputer integrated manufacturing (CIM) has enormous benefits as it increases the rate of production, reduces errors and production waste, and streamlines manufacturing sub-systems. However, there are some new challenges related to CIM operating in the Internet of Things/Internet of Data (IoT/IoD) scenarios associated with Industry 4.0 and cyber-physical systems. The main challenge is to deal with the massive volume of data flowing...