Search
Filters
total: 242
filtered: 188
-
Catalog
Chosen catalog filters
Search results for: BIG DATA
-
BIG PROBLEMS WITH BIG DATA
PublicationThe article presents an overview of the most important issues related to the phenomenon called big data. The characteristics of big data concerning the data itself and the data sources are presented. Then, the big data life cycle concept is formulated. The next sections focus on two big data technologies: MapReduce for big data processing and NoSQL databases for big data storage.
-
Big Data in Regenerative Urban Design
PublicationWhy the use of Big Data in regenerative planning matters? The aim of this chapter is to study under what conditions Big Data can be integrated into regenerative design and sustainable planning? Authors seek to answer how – when related to the ecosystem and to human activities – Big Data can be used to: • both shape policies that support the development of regenerative human settlements, • support restorative design for practitioners...
-
The Use of Big Data in Regenerative Planning
PublicationWith the increasing significance of Big Data sources and their reliability for studying current urban development processes, new possibilities have appeared for analyzing the urban planning of contemporary cities. At the same time, the new urban development paradigm related to regenerative sustainability requires a new approach and hence a better understanding of the processes changing cities today, which will allow more efficient...
-
"Big data" i Wielki Brat
PublicationFelieton popularnonaukowy dotyczący ochrony prywatności danych.
-
Harmony Search for Data Mining with Big Data
PublicationIn this paper, some harmony search algorithms have been proposed for data mining with big data. Three areas of big data processing have been studied to apply new metaheuristics. The first problem is related to MapReduce architecture that can be supported by a team of harmony search agents in grid infrastructure. The second dilemma involves development of harmony search in preprocessing of data series before data mining. Moreover,...
-
Big Data i 5V – nowe wyzwania w świecie danych (Big Data and 5V – New Challenges in the World of Data)
PublicationRodzaje danych, składające się na zbiory typu Big Data, to m.in. dane generowane przez użytkowników portali internetowych, dane opisujące transakcje dokonywane poprzez Internet, dane naukowe (biologiczne, astronomiczne, pomiary fizyczne itp.), dane generowane przez roboty w wyniku automatycznego przeszukiwania przez nie Internetu (Web mining, Web crawling), dane grafowe obrazujące powiązania pomiędzy stronami WWW itd. Zazwyczaj,...
-
Big Data Analytics for ICT Monitoring and Development
PublicationThe expanded growth of information and communication technology has opened new era of digitization which is proving to be a great challenge for researchers and scientists around the globe. The utmost paradigm is to handle and process the explosion of data with minimal cost and discover relevant hidden information in the least amount of time. The buzz word “BIG DATA” is a widely anticipated term with the potential to handle heterogeneous,...
-
How ethics combine with big data: a bibliometric analysis
PublicationThe term Big Data is becoming increasingly widespread throughout the world, and its use is no longer limited to the IT industry, quantitative scientific research, and entrepreneurship, but entered as well everyday media and conversations. The prevalence of Big Data is simply a result of its usefulness in searching, downloading, collecting and processing massive datasets. It is therefore not surprising that the number of scientific...
-
Review of the Complexity of Managing Big Data of the Internet of Things
PublicationTere is a growing awareness that the complexity of managing Big Data is one of the main challenges in the developing feld of the Internet of Tings (IoT). Complexity arises from several aspects of the Big Data life cycle, such as gathering data, storing them onto cloud servers, cleaning and integrating the data, a process involving the last advances in ontologies, such as Extensible Markup Language (XML) and Resource Description...
-
Artysta i analityk. Big data w przestrzeni kultury
PublicationTekst rozważa rolę Big Data - ogromnych zbiorów danych - w badaniu kultury oraz w jej tworzeniu. Przedmiotem analiz jest również wpływ tej technologii na twórczość artystyczną, w tym na współczesną architekturę i urbanistykę. Przedstawione zostały scenariusze potencjalnej przyszłej roli Big Data w społeczeństwie.
-
Big Data and the Internet of Things in Edge Computing for Smart City
PublicationRequests expressing collective human expectations and outcomes from city service tasks can be partially satisfied by processing Big Data provided to a city cloud via the Internet of Things. To improve the efficiency of the city clouds an edge computing has been introduced regarding Big Data mining. This intelligent and efficient distributed system can be developed for citizens that are supposed to be informed and educated by the...
-
Big Data Processing by Volunteer Computing Supported by Intelligent Agents
PublicationIn this paper, volunteer computing systems have been proposed for big data processing. Moreover, intelligent agents have been developed to efficiency improvement of a grid middleware layer. In consequence, an intelligent volunteer grid has been equipped with agents that belong to five sets. The first one consists of some user tasks. Furthermore, two kinds of semi-intelligent tasks have been introduced to implement a middleware...
-
Fragmentation of Hydrographic Big Data Into Subsets During Reduction Process
PublicationThe article presented problems of fragmentation of hydrographic big data into smaller subsets during reduction process. Data reduction is a processing of reduce the value of the data set, in order to make them easier and more effective for the goals of the analysis. The main aim of authors is to create new reduction method. The article presented the first stage of this method – fragmentation of bathymetric data into subsets. It...
-
On a Certain Research Gap in Big Data Mining for Customer Insights
Publication -
On the impact of Big Data and Cloud Computing on a scalable multimedia archiving system
PublicationMultimedia Archiver (MA) is a system build upon the promise and fascination of the possibilities emerging from cloud computing and big data. We aim to present and describe how the Multimedia Archiving system works for us to record, put in context and allow a swift access to large amounts of data. We introduce the architecture, identified goals and needs taken into account while designing a system processing data with Big Data...
-
Collective citizens' behavior modelling with support of the Internet of Things and Big Data
PublicationIn this paper, collective human behaviors are modelled by a development of Big Data mining related to the Internet of Things. Some studies under MapReduce architectures have been carried out to improve an efficiency of Big Data mining. Intelligent agents in data mining have been analyzed for smart city systems, as well as data mining has been described by genetic programming. Furthermore, artificial neural networks have been discussed...
-
Harmony Search to Self-Configuration of Fault-Tolerant Grids for Big Data
PublicationIn this paper, harmony search algorithms have been proposed to self-configuration of fault-tolerant grids for big data processing. Some tasks related to big data processing have been considered. Moreover, two criteria have been applied to evaluate quality of grids. The first criterion is a probability that all tasks meet their deadlines and the second one is grid reliability. Furthermore, some intelligent agents based on harmony...
-
General concept of reduction process for big data obtained by interferometric methods
PublicationInterferometric sonar systems apply the phase content of the sonar signal to measure the angle of a wave front returned from the seafloor or from a target. It collect a big data – datasets that are so large or complex that traditional data processing application software is inadequate to deal with them. The recording a large number of data is associated with the difficulty of their efficient use. So data have to be reduced. The main...
-
Methodology for Processing of 3D Multibeam Sonar Big Data for Comparative Navigation
PublicationAutonomous navigation is an important task for unmanned vehicles operating both on the surface and underwater. A sophisticated solution for autonomous non-global navigational satellite system navigation is comparative (terrain reference) navigation. We present a method for fast processing of 3D multibeam sonar data to make depth area comparable with depth areas from bathymetric electronic navigational charts as source maps during...
-
A Workflow Application for Parallel Processing of Big Data from an Internet Portal
PublicationThe paper presents a workflow application for efficient parallel processing of data downloaded from an Internet portal. The workflow partitions input files into subdirectories which are further split for parallel processing by services installed on distinct computer nodes. This way, analysis of the first ready subdirectories can start fast and is handled by services implemented as parallel multithreaded applications using multiple...
-
Big Data Paradigm Developed in Volunteer Grid System with Genetic Programming Scheduler
PublicationArtificial intelligence techniques are capable to handle a large amount of information collected over the web. In this paper, big data paradigm has been studied in volunteer and grid system called Comcute that is optimized by a genetic programming scheduler. This scheduler can optimize load balancing and resource cost. Genetic programming optimizer has been applied for finding the Pareto solu-tions. Finally, some results from numerical...
-
Optymalizacja parametrów aplikacji w procesie wytwarzania oprogramowania dla Big Data
PublicationWytwarzanie oprogramowania wiąże się z szeregiem decyzji projektowych obejmujących architekturę aplikacji, wykorzystywane technologie implementacji, jak i zewnętrzne biblioteki. W pracy przedstawiono metodę wyboru technologii i bibliotek związanych z big data, której celem jest optymalizacja atrybutów aplikacji takich jak wydajność działajacej aplikacji jak również optymalizacja procesu wytwarzania oprogramowania. Metoda wyboru...
-
BIG DATA SIGNIFICANCE IN REMOTE MEDICAL DIAGNOSTICS BASED ON DEEP LEARNING TECHNIQUES
PublicationIn this paper we discuss the evaluation of neural networks in accordance with medical image classification and analysis. We also summarize the existing databases with images which could be used for training deep models that can be later utilized in remote home-based health care systems. In particular, we propose methods for remote video-based estimation of patient vital signs and other health-related parameters. Additionally, potential...
-
Self-organizing Artificial Neural Networks into Hydrographic Big Data Reduction Process
Publication -
Overcoming “Big Data” Barriers in Machine Learning Techniques for the Real-Life Applications
Publication -
Music information retrieval—The impact of technology, crowdsourcing, big data, and the cloud in art.
PublicationThe exponential growth of computer processing power, cloud data storage, and crowdsourcing model of gathering data bring new possibilities to music information retrieval (mir) field. Mir is no longer music content retrieval only; the area also comprises the discovery of expressing feelings and emotions contained in music, incorporating other than hearing modalities for helping this issue, users’ profiling, merging music with social...
-
Impact of AI-Based Tools and Urban Big Data Analytics on the Design and Planning of Cities
PublicationWide access to large volumes of urban big data and artificial intelligence (AI)-based tools allow performing new analyses that were previously impossible due to the lack of data or their high aggregation. This paper aims to assess the possibilities of the use of urban big data analytics based on AI-related tools to support the design and planning of cities. To this end, the author introduces a conceptual framework to assess the...
-
Advances in Architectures, Big Data, and Machine Learning Techniques for Complex Internet of Things Systems
PublicationTe feld of Big Data is rapidly developing with a lot of ongoing research, which will likely continue to expand in the future. A crucial part of this is Knowledge Discovery from Data (KDD), also known as the Knowledge Discovery Process (KDP). Tis process is a very complex procedure, and for that reason it is essential to divide it into several steps (Figure 1). Some authors use fve steps to describe this procedure, whereas others...
-
Influence of YARN Schedulers on Power Consumption and Processing Time for Various Big Data Benchmarks
PublicationClimate change caused by human activities can influence the lives of everybody onthe planet. The environmental concerns must be taken into consideration by all fields of studyincludingICT. Green Computing aims to reduce negative effects of IT on the environment while,at the same time, maintaining all of the possible benefits it provides. Several Big Data platformslike Apache Spark orYARNhave become widely used in analytics and...
-
Big Data from Sensor Network via Internet of Things to Edge Deep Learning for Smart City
PublicationData from a physical world is sampled by sensor networks, and then streams of Big Data are sent to cloud hosts to support decision making by deep learning software. In a smart city, some tasks may be assigned to smart devices of the Internet of Things for performing edge computing. Besides, a part of workload of calculations can be transferred to the cloud hosts. This paper proposes benchmarks for division tasks between an edge...
-
Application of computational intelligence models in IoMT big data for heart disease diagnosis in personalized health care
Publication -
The image of the City on social media: A comparative study using “Big Data” and “Small Data” methods in the Tri-City Region in Poland
Publication“The Image of the City” by Kevin Lynch is a landmark planning theory of lasting influence; its scientific rigor and relevance in the digital age were in dispute. The rise of social media and other digital technologies offers new opportunities to study the perception of urban environments. Questions remain as to whether social media analytics can provide a reliable measure of perceived city images? If yes, what implication does...
-
Know your safety indicator – A determination of merchant vessels Bow Crossing Range based on big data analytics
PublicationEven in the era of automatization maritime safety constantly needs improvements. Regardless of the presence of crew members on board, both manned and autonomous ships should follow clear guidelines (no matter as bridge procedures or algorithms). To date, many safety indicators, especially in collision avoidance have been proposed. One of such parameters commonly used in day-to-day navigation but usually omitted by researchers is...
-
An Approach to Data Reduction for Learning from Big Datasets: Integrating Stacking, Rotation, and Agent Population Learning Techniques
Publication -
High performance filtering for big datasets from Airborne Laser Scanning with CUDA technology
PublicationThere are many studies on the problems of processing big datasets provided by Airborne Laser Scanning (ALS). The processing of point clouds is often executed in stages or on the fragments of the measurement set. Therefore, solutions that enable the processing of the entire cloud at the same time in a simple, fast, efficient way are the subject of many researches. In this paper, authors propose to use General-Purpose computation...
-
Neural network training with limited precision and asymmetric exponent
PublicationAlong with an extremely increasing number of mobile devices, sensors and other smart utilities, an unprecedented growth of data can be observed in today’s world. In order to address multiple challenges facing the big data domain, machine learning techniques are often leveraged for data analysis, filtering and classification. Wide usage of artificial intelligence with large amounts of data creates growing demand not only for storage...
-
Data governance: Organizing data for trustworthy Artificial Intelligence
PublicationThe rise of Big, Open and Linked Data (BOLD) enables Big Data Algorithmic Systems (BDAS) which are often based on machine learning, neural networks and other forms of Artificial Intelligence (AI). As such systems are increasingly requested to make decisions that are consequential to individuals, communities and society at large, their failures cannot be tolerated, and they are subject to stringent regulatory and ethical requirements....
-
Processing of Satellite Data in the Cloud
PublicationThe dynamic development of digital technologies, especially those dedicated to devices generating large data streams, such as all kinds of measurement equipment (temperature and humidity sensors, cameras, radio-telescopes and satellites – Internet of Things) enables more in-depth analysis of the surrounding reality, including better understanding of various natural phenomenon, starting from atomic level reactions, through macroscopic...
-
Experience marketing in the service of the “secular religion” of big tech
PublicationThe article proposes an interpretation of the meaning of experience marketing as a tool in the process of sacralisation of products, and in a broader context – the so-called secular religion accompanying some contemporary big tech organizations. The article is of theoretical nature and the authors have intended to explain how big tech corporations, in line with the concept of experience marketing (digital platforms, in particular),...
-
DUABI - Business Intelligence Architecture for Dual Perspective Analytics
PublicationA significant expansion of Big Data and NoSQL databases made it necessary to develop new architectures for Business Intelligence systems based on data organized in a non-relational way. There are many novel solutions combining Big Data technologies with Data Warehousing. However, the proposed solutions are often not sufficient enough to meet the increasing business demands, such as low data latency while still maintaining high...
-
Harmony Search for Self-configuration of Fault–Tolerant and Intelligent Grids
PublicationIn this paper, harmony search algorithms have been proposed to self-configuration of fault-tolerant grids for big data processing. Self-configuration of computer grids lies in the fact that new computer nodes are automatically configured by software agents and then integrated into the grid. A base node works due to several configuration parameters that define some aspects of data communications and energy power consumption. We...
-
Application of Web-GIS for Dissemination and 3D Visualization of Large-Volume LiDAR Data
PublicationThe increasing number of digital data sources, which allow for semi-automatic collection and storage of information regarding various aspects of life has recently granted a considerable rise in popularity to the term “Big data”. As far as geospatial data is concerned, one of the major sources of Big data are Light Detection And Ranging (LiDAR) scanners, which produce high resolution three-dimensional data on a local scale. The...
-
Sensors and Sensor’s Fusion in Autonomous Vehicles
PublicationAutonomous vehicle navigation has been at the center of several major developments, both in civilian and defense applications. New technologies such as multisensory data fusion, big data processing, and deep learning are changing the quality of areas of applications, improving the sensors and systems used. New ideas such as 3D radar, 3D sonar, LiDAR, and others are based on autonomous vehicle revolutionary development. The Special...
-
A link between seasonality and radiation-related toxicity: The big time or time will tell?
Publication -
Simulation of parallel similarity measure computations for large data sets
PublicationThe paper presents our approach to implementation of similarity measure for big data analysis in a parallel environment. We describe the algorithm for parallelisation of the computations. We provide results from a real MPI application for computations of similarity measures as well as results achieved with our simulation software. The simulation environment allows us to model parallel systems of various sizes with various components...
-
Performance evaluation of the construction products as a research challenge. Small error – big difference in assessment?
Publication -
Big Beautiful Buildings: Eine Schönheit, viele Maßstäbe - urbane Landschaften der Nachkriegsmoderne in Europa / Big Beautiful Buildings: one beauty, many scales - urban landscapes of the post-war modernism across Europe
PublicationMassive urbanization in Europe is not a phenomenon that began only in the 20th century. The roots of this process can be traced back two centuries. With the end of the Second World War the specific conjunction of powerful forces together changed the landscape of European cities. Urbanization was undoubtedly one of them. Among other factors, Musterd and van Kempen (2005) correctly itemized not only objective processes that can be...
-
Sensors and System for Vehicle Navigation
PublicationIn recent years, vehicle navigation, in particular autonomous navigation, has been at the center of several major developments, both in civilian and defense applications. New technologies, such as multisensory data fusion, big data processing, or deep learning, are changing the quality of areas of applications, improving the sensors and systems used. Recently, the influence of artificial intelligence on sensor data processing and...
-
Small Urban Hacks - Big Impact! Tackling major urban challenges through acupunctural smallness
PublicationSmall urban hacks, acupunctural action and process-oriented planning approaches might appear to address quite a socio-romantic attitude towards our urban environments. In this chapter, our aim is to remedy such a biased view, demonstrating the impact and potential of smallness in the context of major urban challenges. Small urban hacks and their multi-faceted and creativity-driven approaches of small is beautiful are selected from...
-
TASK CLOUD INFRASTRUCTURE IN THE CENTRE OF INFORMATICS – TRICITY ACADEMIC SUPERCOMPUTER & NETWORK
PublicationThe cloud solution called the TASK cloud is described. Its main components and the way of their implementation are described. Examples of deployed environments based on the cloud are also presented. Moreover, the idea of combining the cloud and big data platforms is suggested and discussed.