Wyniki wyszukiwania dla: APACHE SPARK,YARN, BIG DATA, GREEN COMPUTING, SENTINEL, TERA SORT, WORDCOUNT, BENCHMARKS, SCHEDULET - MOST Wiedzy

Wyszukiwarka

Wyniki wyszukiwania dla: APACHE SPARK,YARN, BIG DATA, GREEN COMPUTING, SENTINEL, TERA SORT, WORDCOUNT, BENCHMARKS, SCHEDULET

Wyniki wyszukiwania dla: APACHE SPARK,YARN, BIG DATA, GREEN COMPUTING, SENTINEL, TERA SORT, WORDCOUNT, BENCHMARKS, SCHEDULET

  • Influence of YARN Schedulers on Power Consumption and Processing Time for Various Big Data Benchmarks

    Climate change caused by human activities can influence the lives of everybody onthe planet. The environmental concerns must be taken into consideration by all fields of studyincludingICT. Green Computing aims to reduce negative effects of IT on the environment while,at the same time, maintaining all of the possible benefits it provides. Several Big Data platformslike Apache Spark orYARNhave become widely used in analytics and...

    Pełny tekst do pobrania w portalu

  • On the impact of Big Data and Cloud Computing on a scalable multimedia archiving system

    Multimedia Archiver (MA) is a system build upon the promise and fascination of the possibilities emerging from cloud computing and big data. We aim to present and describe how the Multimedia Archiving system works for us to record, put in context and allow a swift access to large amounts of data. We introduce the architecture, identified goals and needs taken into account while designing a system processing data with Big Data...

    Pełny tekst do pobrania w serwisie zewnętrznym

  • Big Data and the Internet of Things in Edge Computing for Smart City

    Publikacja

    - Rok 2019

    Requests expressing collective human expectations and outcomes from city service tasks can be partially satisfied by processing Big Data provided to a city cloud via the Internet of Things. To improve the efficiency of the city clouds an edge computing has been introduced regarding Big Data mining. This intelligent and efficient distributed system can be developed for citizens that are supposed to be informed and educated by the...

    Pełny tekst do pobrania w serwisie zewnętrznym

  • Big Data Processing by Volunteer Computing Supported by Intelligent Agents

    Publikacja

    In this paper, volunteer computing systems have been proposed for big data processing. Moreover, intelligent agents have been developed to efficiency improvement of a grid middleware layer. In consequence, an intelligent volunteer grid has been equipped with agents that belong to five sets. The first one consists of some user tasks. Furthermore, two kinds of semi-intelligent tasks have been introduced to implement a middleware...

    Pełny tekst do pobrania w serwisie zewnętrznym

  • Big Data i 5V – nowe wyzwania w świecie danych (Big Data and 5V – New Challenges in the World of Data)

    Publikacja

    - Rok 2014

    Rodzaje danych, składające się na zbiory typu Big Data, to m.in. dane generowane przez użytkowników portali internetowych, dane opisujące transakcje dokonywane poprzez Internet, dane naukowe (biologiczne, astronomiczne, pomiary fizyczne itp.), dane generowane przez roboty w wyniku automatycznego przeszukiwania przez nie Internetu (Web mining, Web crawling), dane grafowe obrazujące powiązania pomiędzy stronami WWW itd. Zazwyczaj,...

  • Magdalena Szuflita-Żurawska

    Magdalena Szuflita-Żurawska jest kierownikiem Sekcji Informacji Naukowo-Technicznej na Politechnice Gdańskiej oraz Liderem Centrum Kompetencji Otwartej Nauki przy Bibliotece Politechniki Gdańskiej. Jej główne zainteresowania badawcze koncentrują się w obszarze komunikacji naukowej oraz otwartych danych badawczych, a także motywacji i produktywności naukowej. Jest odpowiedzialna między innymi za prowadzenie szkoleń dla pracowników...

  • BIG PROBLEMS WITH BIG DATA

    Publikacja

    The article presents an overview of the most important issues related to the phenomenon called big data. The characteristics of big data concerning the data itself and the data sources are presented. Then, the big data life cycle concept is formulated. The next sections focus on two big data technologies: MapReduce for big data processing and NoSQL databases for big data storage.

    Pełny tekst do pobrania w portalu

  • Harmony Search for Data Mining with Big Data

    Publikacja

    - Rok 2016

    In this paper, some harmony search algorithms have been proposed for data mining with big data. Three areas of big data processing have been studied to apply new metaheuristics. The first problem is related to MapReduce architecture that can be supported by a team of harmony search agents in grid infrastructure. The second dilemma involves development of harmony search in preprocessing of data series before data mining. Moreover,...

    Pełny tekst do pobrania w serwisie zewnętrznym

  • Big Data in Regenerative Urban Design

    Why the use of Big Data in regenerative planning matters? The aim of this chapter is to study under what conditions Big Data can be integrated into regenerative design and sustainable planning? Authors seek to answer how – when related to the ecosystem and to human activities – Big Data can be used to: • both shape policies that support the development of regenerative human settlements, • support restorative design for practitioners...

    Pełny tekst do pobrania w serwisie zewnętrznym

  • The Use of Big Data in Regenerative Planning

    With the increasing significance of Big Data sources and their reliability for studying current urban development processes, new possibilities have appeared for analyzing the urban planning of contemporary cities. At the same time, the new urban development paradigm related to regenerative sustainability requires a new approach and hence a better understanding of the processes changing cities today, which will allow more efficient...

    Pełny tekst do pobrania w portalu

  • Big Data and Cognitive Computing

    Czasopisma

    eISSN: 2504-2289

  • Big Data Analytics for ICT Monitoring and Development

    Publikacja

    - Rok 2017

    The expanded growth of information and communication technology has opened new era of digitization which is proving to be a great challenge for researchers and scientists around the globe. The utmost paradigm is to handle and process the explosion of data with minimal cost and discover relevant hidden information in the least amount of time. The buzz word “BIG DATA” is a widely anticipated term with the potential to handle heterogeneous,...

    Pełny tekst do pobrania w serwisie zewnętrznym

  • Big Data from Sensor Network via Internet of Things to Edge Deep Learning for Smart City

    Publikacja

    - Rok 2021

    Data from a physical world is sampled by sensor networks, and then streams of Big Data are sent to cloud hosts to support decision making by deep learning software. In a smart city, some tasks may be assigned to smart devices of the Internet of Things for performing edge computing. Besides, a part of workload of calculations can be transferred to the cloud hosts. This paper proposes benchmarks for division tasks between an edge...

    Pełny tekst do pobrania w serwisie zewnętrznym

  • Analiza danych typu Big Data 2022/23

    Kursy Online
    • P. Weichbroth
    • W. Waloszek

    The aim of the course is to familiarize students with the methods of storing and analysis of big data. Practical tools for these tasks are presented.

  • Harmony Search to Self-Configuration of Fault-Tolerant Grids for Big Data

    In this paper, harmony search algorithms have been proposed to self-configuration of fault-tolerant grids for big data processing. Some tasks related to big data processing have been considered. Moreover, two criteria have been applied to evaluate quality of grids. The first criterion is a probability that all tasks meet their deadlines and the second one is grid reliability. Furthermore, some intelligent agents based on harmony...

    Pełny tekst do pobrania w serwisie zewnętrznym

  • Review of the Complexity of Managing Big Data of the Internet of Things

    Publikacja

    - COMPLEXITY - Rok 2019

    Tere is a growing awareness that the complexity of managing Big Data is one of the main challenges in the developing feld of the Internet of Tings (IoT). Complexity arises from several aspects of the Big Data life cycle, such as gathering data, storing them onto cloud servers, cleaning and integrating the data, a process involving the last advances in ontologies, such as Extensible Markup Language (XML) and Resource Description...

    Pełny tekst do pobrania w portalu

  • Coastal zone monitoring using Sentinel-1 SAR polarymetry data

    Publikacja

    In recent years the role of the surveillance and security of Polish boundaries has significantly increased. Polish coastal zone monitoring requires various approaches using various technological means in order to ensure the protection of Polish boundaries. In this paper, the authors discuss and present alternatives to underwater surveillance methods of coastal area analysis and monitoring using data retrieved from the newly developed...

    Pełny tekst do pobrania w portalu

  • How ethics combine with big data: a bibliometric analysis

    The term Big Data is becoming increasingly widespread throughout the world, and its use is no longer limited to the IT industry, quantitative scientific research, and entrepreneurship, but entered as well everyday media and conversations. The prevalence of Big Data is simply a result of its usefulness in searching, downloading, collecting and processing massive datasets. It is therefore not surprising that the number of scientific...

    Pełny tekst do pobrania w portalu

  • Big Data

    Czasopisma

    ISSN: 2167-6461 , eISSN: 2167-647X

  • Analiza danych typu Big Data 2023/24 KOPIA

    Kursy Online
    • W. Waloszek

    The aim of the course is to familiarize students with the methods of storing and analysis of big data. Practical tools for these tasks are presented.

  • Processing of Satellite Data in the Cloud

    Publikacja

    The dynamic development of digital technologies, especially those dedicated to devices generating large data streams, such as all kinds of measurement equipment (temperature and humidity sensors, cameras, radio-telescopes and satellites – Internet of Things) enables more in-depth analysis of the surrounding reality, including better understanding of various natural phenomenon, starting from atomic level reactions, through macroscopic...

    Pełny tekst do pobrania w portalu

  • Artysta i analityk. Big data w przestrzeni kultury

    Publikacja

    - Rok 2015

    Tekst rozważa rolę Big Data - ogromnych zbiorów danych - w badaniu kultury oraz w jej tworzeniu. Przedmiotem analiz jest również wpływ tej technologii na twórczość artystyczną, w tym na współczesną architekturę i urbanistykę. Przedstawione zostały scenariusze potencjalnej przyszłej roli Big Data w społeczeństwie.

    Pełny tekst do pobrania w serwisie zewnętrznym

  • Big Data 2023

    Kursy Online
    • P. Jasik

  • Collective citizens' behavior modelling with support of the Internet of Things and Big Data

    In this paper, collective human behaviors are modelled by a development of Big Data mining related to the Internet of Things. Some studies under MapReduce architectures have been carried out to improve an efficiency of Big Data mining. Intelligent agents in data mining have been analyzed for smart city systems, as well as data mining has been described by genetic programming. Furthermore, artificial neural networks have been discussed...

    Pełny tekst do pobrania w serwisie zewnętrznym

  • Big Data processing frameworks - 2022

    Kursy Online
    • A. Przybyłek

    Informatics, postgraduate studies Data Engineering, undergraduate studies

  • Big Data processing frameworks - 2023

    Kursy Online
    • A. Przybyłek

    Informatics, postgraduate studies Data Engineering, undergraduate studies

  • Big Data processing frameworks - 2024

    Kursy Online
    • A. Przybyłek

    Informatics, postgraduate studies Data Engineering, undergraduate studies

  • Fragmentation of Hydrographic Big Data Into Subsets During Reduction Process

    Publikacja

    - Rok 2017

    The article presented problems of fragmentation of hydrographic big data into smaller subsets during reduction process. Data reduction is a processing of reduce the value of the data set, in order to make them easier and more effective for the goals of the analysis. The main aim of authors is to create new reduction method. The article presented the first stage of this method – fragmentation of bathymetric data into subsets. It...

    Pełny tekst do pobrania w serwisie zewnętrznym

  • Impact of AI-Based Tools and Urban Big Data Analytics on the Design and Planning of Cities

    Publikacja

    Wide access to large volumes of urban big data and artificial intelligence (AI)-based tools allow performing new analyses that were previously impossible due to the lack of data or their high aggregation. This paper aims to assess the possibilities of the use of urban big data analytics based on AI-related tools to support the design and planning of cities. To this end, the author introduces a conceptual framework to assess the...

    Pełny tekst do pobrania w portalu

  • GREEN CHEMISTRY

    Czasopisma

    ISSN: 1463-9262 , eISSN: 1463-9270

  • The image of the City on social media: A comparative study using “Big Data” and “Small Data” methods in the Tri-City Region in Poland

    Publikacja

    “The Image of the City” by Kevin Lynch is a landmark planning theory of lasting influence; its scientific rigor and relevance in the digital age were in dispute. The rise of social media and other digital technologies offers new opportunities to study the perception of urban environments. Questions remain as to whether social media analytics can provide a reliable measure of perceived city images? If yes, what implication does...

    Pełny tekst do pobrania w portalu

  • Big Data Research

    Czasopisma

    ISSN: 2214-5796

  • Big Data & Society

    Czasopisma

    ISSN: 2053-9517

  • Frontiers in Big Data

    Czasopisma

    eISSN: 2624-909X

  • Big Earth Data

    Czasopisma

    ISSN: 2096-4471 , eISSN: 2574-5417

  • Methodology for Processing of 3D Multibeam Sonar Big Data for Comparative Navigation

    Publikacja

    - Remote Sensing - Rok 2019

    Autonomous navigation is an important task for unmanned vehicles operating both on the surface and underwater. A sophisticated solution for autonomous non-global navigational satellite system navigation is comparative (terrain reference) navigation. We present a method for fast processing of 3D multibeam sonar data to make depth area comparable with depth areas from bathymetric electronic navigational charts as source maps during...

    Pełny tekst do pobrania w portalu

  • General concept of reduction process for big data obtained by interferometric methods

    Publikacja

    - Rok 2017

    Interferometric sonar systems apply the phase content of the sonar signal to measure the angle of a wave front returned from the seafloor or from a target. It collect a big data – datasets that are so large or complex that traditional data processing application software is inadequate to deal with them. The recording a large number of data is associated with the difficulty of their efficient use. So data have to be reduced. The main...

    Pełny tekst do pobrania w serwisie zewnętrznym

  • Big Data Paradigm Developed in Volunteer Grid System with Genetic Programming Scheduler

    Artificial intelligence techniques are capable to handle a large amount of information collected over the web. In this paper, big data paradigm has been studied in volunteer and grid system called Comcute that is optimized by a genetic programming scheduler. This scheduler can optimize load balancing and resource cost. Genetic programming optimizer has been applied for finding the Pareto solu-tions. Finally, some results from numerical...

    Pełny tekst do pobrania w serwisie zewnętrznym

  • Advances in Architectures, Big Data, and Machine Learning Techniques for Complex Internet of Things Systems

    Publikacja

    - COMPLEXITY - Rok 2019

    Te feld of Big Data is rapidly developing with a lot of ongoing research, which will likely continue to expand in the future. A crucial part of this is Knowledge Discovery from Data (KDD), also known as the Knowledge Discovery Process (KDP). Tis process is a very complex procedure, and for that reason it is essential to divide it into several steps (Figure 1). Some authors use fve steps to describe this procedure, whereas others...

    Pełny tekst do pobrania w portalu

  • Analiza danych typu Big Data

    Kursy Online
    • P. Weichbroth
    • M. Kaczmarek
    • W. Waloszek

  • "Big data" i Wielki Brat

    Publikacja

    Felieton popularnonaukowy dotyczący ochrony prywatności danych.

    Pełny tekst do pobrania w serwisie zewnętrznym

  • Fluorescence Imaging Using Methylene Blue Sentinel Lymph Node Biopsy in Melanoma

    Publikacja
    • T. Cwalinski
    • J. Skokowski
    • W. Polom
    • L. Marano
    • M. Swierblewski
    • K. Drucis
    • G. Roviello
    • N. Cwalina
    • L. Kalinowski
    • F. Roviello
    • K. Polom

    - Surgical Innovation - Rok 2022

    Introduction: Fluorescence imaging of sentinel node biopsy in melanoma is a novel method. Both indocyanine green (ICG) and methylene blue (MB) have fl uorescent properties. The aim of this study was to present, for the fi rst time in a clinical series of patients, the possible usage of MB as a fl uorescent dye for sentinel node biopsy during surgery for melanoma. Material and methods: Twenty patients with...

    Pełny tekst do pobrania w serwisie zewnętrznym

  • Optymalizacja parametrów aplikacji w procesie wytwarzania oprogramowania dla Big Data

    Wytwarzanie oprogramowania wiąże się z szeregiem decyzji projektowych obejmujących architekturę aplikacji, wykorzystywane technologie implementacji, jak i zewnętrzne biblioteki. W pracy przedstawiono metodę wyboru technologii i bibliotek związanych z big data, której celem jest optymalizacja atrybutów aplikacji takich jak wydajność działajacej aplikacji jak również optymalizacja procesu wytwarzania oprogramowania. Metoda wyboru...

    Pełny tekst do pobrania w portalu

  • Paweł Czarnul dr hab. inż.

    Paweł Czarnul uzyskał stopień doktora habilitowanego w dziedzinie nauk technicznych w dyscyplinie informatyka w roku 2015 zaś stopień doktora nauk technicznych w zakresie informatyki(z wyróżnieniem) nadany przez Radę Wydziału Elektroniki, Telekomunikacji i Informatyki Politechniki Gdańskiej w roku 2003. Dziedziny jego zainteresowań obejmują: przetwarzanie równoległei rozproszone w tym programowanie równoległe na klastrach obliczeniowych,...

  • Methylene Blue Near-Infrared Fluorescence Imaging in Breast Cancer Sentinel Node Biopsy

    Publikacja
    • O. Budner
    • T. Cwalinski
    • J. Skokowski
    • L. Marano
    • L. Resca
    • N. Cwalina
    • L. Kalinowski
    • R. Hoveling
    • F. Roviello
    • K. Polom

    - Cancers - Rok 2022

    Introduction: Fluorescence-based navigation for breast cancer sentinel node biopsy is a novel method that uses indocyanine green as a fluorophore. However, methylene blue (MB) also has some fluorescent properties. This study is the first in a clinical series presenting the possible use of MB as a fluorescent dye for the identification of sentinel nodes in breast sentinel node biopsy. Material and methods: Forty-nine patients with...

    Pełny tekst do pobrania w portalu

  • IEEE Transactions on Big Data

    Czasopisma

    ISSN: 2332-7790

  • Big Data Mining and Analytics

    Czasopisma

    ISSN: 2096-0654

  • Efficiency Evaluation of High Performance Computing Systems Using Data Envelopment Analysis

    Publikacja

    - Rok 2014

    The paper presents an evaluation method of high performance computing (HPC) systems using multicriteria efficiency analysis. The Data Envelopment Analysis approach was applied and adapted to the specifics of HPC, which enabled us to compare relative efficiency of systems considering simultaneously multiple parameters. The analysis is based on the TOP500 list of world largest supercomputers and their parameters such as: the number...

  • A Workflow Application for Parallel Processing of Big Data from an Internet Portal

    Publikacja

    - Rok 2014

    The paper presents a workflow application for efficient parallel processing of data downloaded from an Internet portal. The workflow partitions input files into subdirectories which are further split for parallel processing by services installed on distinct computer nodes. This way, analysis of the first ready subdirectories can start fast and is handled by services implemented as parallel multithreaded applications using multiple...

    Pełny tekst do pobrania w serwisie zewnętrznym

  • Computing and Software for Big Science

    Czasopisma

    eISSN: 2510-2044