검색

검색

  • Home
  • 기능목록
  • 검색

상세정보

Hands-on big data analytics with PySpark : analyze large datasets and discover techniques for testing, immunizing, and parallelizing Spark jobs

QR코드
도서 상세정보
자료유형 : eBook
ISBN : 1838648836 
ISBN : 9781838648831 
ISBN :
개인저자 : Lai, Rudy, author.
서명/저자사항 : Hands-on big data analytics with PySpark:  analyze large datasets and discover techniques for testing, immunizing, and parallelizing Spark jobs /:  Rudy Lai, Bartłomiej Potaczek. 
발행사항 : Birmingham, UK:  Packt Publishing,  2019. 
형태사항 : 1 online resource:  illustrations. 
내용주기 : Cover; Title Page; Copyright and Credits; About Packt; Contributors; Table of Contents; Preface; Chapter 1: Pyspark and Setting up Your Development Environment; An overview of PySpark; Spark SQL; Setting up Spark on Windows and PySpark; Core concepts in Spark and PySpark; SparkContext; Spark shell; SparkConf; Summary; Chapter 2: Getting Your Big Data into the Spark Environment Using RDDs; Loading data on to Spark RDDs; The UCI machine learning repository; Getting the data from the repository to Spark; Getting data into Spark; Parallelization with Spark RDDs; What is parallelization? 
내용주기 : Basics of RDD operationSummary; Chapter 3: Big Data Cleaning and Wrangling with Spark Notebooks; Using Spark Notebooks for quick iteration of ideas; Sampling/filtering RDDs to pick out relevant data points; Splitting datasets and creating some new combinations; Summary; Chapter 4: Aggregating and Summarizing Data into Useful Reports; Calculating averages with map and reduce; Faster average computations with aggregate; Pivot tabling with key-value paired data points; Summary; Chapter 5: Powerful Exploratory Data Analysis with MLlib; Computing summary statistics with MLlib 
내용주기 : Using Pearson and Spearman correlations to discover correlationsThe Pearson correlation; The Spearman correlation; Computing Pearson and Spearman correlations; Testing our hypotheses on large datasets; Summary; Chapter 6: Putting Structure on Your Big Data with SparkSQL; Manipulating DataFrames with Spark SQL schemas; Using Spark DSL to build queries; Summary; Chapter 7: Transformations and Actions; Using Spark transformations to defer computations to a later time; Avoiding transformations; Using the reduce and reduceByKey methods to calculate the results 
내용주기 : Performing actions that trigger computationsReusing the same rdd for different actions; Summary; Chapter 8: Immutable Design; Delving into the Spark RDD's parent/child chain; Extending an RDD; Chaining a new RDD with the parent; Testing our custom RDD; Using RDD in an immutable way; Using DataFrame operations to transform; Immutability in the highly concurrent environment; Using the Dataset API in an immutable way; Summary; Chapter 9: Avoiding Shuffle and Reducing Operational Expenses; Detecting a shuffle in a process; Testing operations that cause a shuffle in Apache Spark 
내용주기 : Changing the design of jobs with wide dependenciesUsing keyBy() operations to reduce shuffle; Using a custom partitioner to reduce shuffle; Summary; Chapter 10: Saving Data in the Correct Format; Saving data in plain text format; Leveraging JSON as a data format; Tabular formats -- CSV; Using Avro with Spark; Columnar formats -- Parquet; Summary; Chapter 11: Working with the Spark Key/Value API; Available actions on key/value pairs; Using aggregateByKey instead of groupBy(); Actions on key/value pairs; Available partitioners on key/value data; Implementing a custom partitioner; Summary 
요약 : In this book, you'll learn to implement some practical and proven techniques to improve aspects of programming and administration in Apache Spark. Techniques are demonstrated using practical examples and best practices. You will also learn how to use Spark and its Python API to create performant analytics with large-scale data. 
일반주제명 : SPARK (Computer program language) -- 
일반주제명 : Application software --  Development. -- 
일반주제명 : Big data. -- 
일반주제명 : Electronic data processing. -- 
일반주제명 : Python (Computer program language) -- 
일반주제명 : Application software --  Development. -- 
일반주제명 : Big data. -- 
일반주제명 : Electronic data processing. -- 
일반주제명 : Python (Computer program language) -- 
일반주제명 : SPARK (Computer program language) -- 
개인저자 : Potaczek, Bartłomiej, author.
기타형태 저록 : Print version: Lai, Rudy. Hands-On Big Data Analytics with Pyspark : Analyze Large Datasets and Discover Techniques for Testing, Immunizing, and Parallelizing Spark Jobs. Birmingham : Packt Publishing Ltd, ©2019, 9781838644130
언어 영어
원문
URL :

예약

  1. 1. 예약현황은 홈페이지 로그인 후 예약 페이지에 확인 가능합니다.
  2. 2. 도착 통보된 예약자료 대출을 원하지 않는 경우에는 예약 현황에서 취소할 수 있습니다.
  3. 3. 기타 문의사항은 도서관에 문의 바랍니다.
닫기

무인예약대출

  1. 1. 무인예약대출 현황은 홈페이지 로그인 후 무인예약대출 페이지에 확인 가능합니다.
  2. 2. 무인예약대출자료 대출을 원하지 않는 경우에는 무인예약대출 페이지에서 신청 또는 접수상태인 경우만 취소할 수 있습니다.
  3. 3. 희망대출일은 신청일로부터 최대 1주일 까지 가능합니다.
  4. 4. 희망대출일을 선택하지 않은 경우 대출대기 통보 후 1주일까지 기기에서 대출가능합니다.
  5. 5. 기타 문의사항은 도서관에 문의 바랍니다.
닫기
서평쓰기

서평쓰기

서평쓰기
닫기
태그추가

태그추가

닫기

QR코드

닫기
챗봇
  • 도서관 대화형 검색봇 서비스 앤디입니다.