org.apache.spark.ml

Class UnaryTransformer<IN,OUT,T extends UnaryTransformer<IN,OUT,T>>

Object

org.apache.spark.ml.PipelineStage

org.apache.spark.ml.Transformer

org.apache.spark.ml.UnaryTransformer<IN,OUT,T>

All Implemented Interfaces:

java.io.Serializable, Logging, Identifiable, HasInputCol, HasOutputCol, Params

Direct Known Subclasses:

HashingTF, Tokenizer

public abstract class UnaryTransformer<IN,OUT,T extends UnaryTransformer<IN,OUT,T>>
extends Transformer
implements HasInputCol, HasOutputCol, Logging

Abstract class for transformers that take one input column, apply transformation, and output the result as a new column.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
UnaryTransformer()

Method Summary

Methods

Modifier and Type	Method and Description
T	setInputCol(String value)
T	setOutputCol(String value)
DataFrame	transform(DataFrame dataset, ParamMap paramMap) Transforms the dataset with provided parameter map as additional parameters.
StructType	transformSchema(StructType schema, ParamMap paramMap) :: DeveloperApi ::

Methods inherited from class org.apache.spark.ml.Transformer

transform, transform

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.ml.param.HasInputCol

getInputCol, inputCol

Methods inherited from interface org.apache.spark.ml.param.HasOutputCol

getOutputCol, outputCol

Methods inherited from interface org.apache.spark.ml.param.Params

addOutputColumn, checkInputColumn, explainParams, get, getParam, isSet, paramMap, params, set, set, validate, validate

Methods inherited from interface org.apache.spark.ml.Identifiable

uid

Methods inherited from interface org.apache.spark.Logging

initializeIfNecessary, initializeLogging, isTraceEnabled, log_, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning

Constructor Detail

UnaryTransformer

public UnaryTransformer()

Method Detail

setInputCol

public T setInputCol(String value)

setOutputCol

public T setOutputCol(String value)

transformSchema

public StructType transformSchema(StructType schema,
                         ParamMap paramMap)

Description copied from class: PipelineStage

:: DeveloperApi ::

Derives the output schema from the input schema and parameters. The schema describes the columns and types of the data.

Specified by:

transformSchema in class PipelineStage

Parameters:

schema - Input schema to this stage

paramMap - Parameters passed to this stage

Returns:

Output schema from this stage

transform

public DataFrame transform(DataFrame dataset,
                  ParamMap paramMap)

Description copied from class: Transformer

Transforms the dataset with provided parameter map as additional parameters.

Specified by:

transform in class Transformer

Parameters:

dataset - input dataset

paramMap - additional parameters, overwrite embedded params

Returns:

transformed dataset