open problems in automatically refactoring legacy java software to use new features in java 8
TRANSCRIPT
Open Problems in Automatical-Open Problems in Automatical-ly Refactoring Legacy Javaly Refactoring Legacy Java
Software to use New FeaturesSoftware to use New Featuresin Java 8in Java 8Raffi Khatchadourian
Computer Systems TechnologyNew York City College of Technology
City University of New York
Programming Research GroupMathematical and Computing Sciences
Tokyo Institute of Technology
June 2, 2015
Based on slides by Duarte Duarte, Eduardo Martins, Miguel Marques andRuben Cordeiro and Horstmann, Cay S. (2014-01-10). Java SE8 for theReally Impatient: A Short Course on the Basics (Java Series). Pearson
Education.
Some HistorySome History
Java was invented in the 90's as an Object-Oriented language.Largest change was in ~2005 with Java 5.
Generics.Enhanced for loops.Annotations.Type-safe enumerations.Concurrency enhancements (AtomicInteger).
Java 8 is MassiveJava 8 is Massive
10 years later, Java 8 is packed with new features.Core changes are to incorporate functional language features.
Functional LanguagesFunctional Languages
Declarative ("what not how").The only state is held in parameters.Traditionally popular in academia and AI.Well-suited for event-driven/concurrent ("reactive") programs.
Lambda ExpressionsLambda Expressions
A block of code that you can pass around so it can beexecuted later, once or multiple times.
Anonymous methods.Reduce verbosity caused by anonymous classes.
LambdasLambdas(int x, int y) -> x + y
() -> 42
(String s) -> {System.out.println(s);}
LambdasLambdasExamplesExamples
BeforeBefore
Button btn = new Button();final PrintStream pStream = ...;btn.setOnAction(new EventHandler<ActionEvent>() { @Override public void handle(ActionEvent e) { pStream.println("Button Clicked!"); }});
AfterAfter
Button btn = new Button();final PrintStream pStream = ...;btn.setOnAction(e -> pStream.println("Button Clicked!"));
LambdasLambdasExamplesExamples
List<String> strs = ...;Collections.sort(strs, (s1, s2) -> Integer.compare(s1.length(), s2.length()));
new Thread(() -> { connectToService(); sendNotification();}).start();
Functional InterfacesFunctional InterfacesSingle Abstract Method Type
Functional InterfacesFunctional InterfacesExampleExample
@FunctionalInterfacepublic interface Runnable { public void run();}
Runnable r = () -> System.out.println("Hello World!");
@FunctionalInterface:May be omitted.Generates an error when there is more than one abstract method.
Can store a lambda expression in a variable.Can return a lambda expression.
java.util.functionjava.util.functionPredicate<T> - a boolean-valued property of an objectConsumer<T> - an action to be performed on an objectFunction<T,R> - a function transforming a T to a RSupplier<T> - provide an instance of a T (such as a factory)UnaryOperator<T> - a function from T to TBinaryOperator<T> - a function from (T,T) to T
Method ReferencesMethod ReferencesTreating an existing method as an instance of a
Functional Interface
Method ReferencesMethod ReferencesExamplesExamples
class Person { private String name; private int age;
public int getAge() {return this.age;} public String getName() {return this.name;}}
Person[] people = ...;Comparator<Person> byName = Comparator.comparing(Person::getName);Arrays.sort(people, byName);
Method ReferencesMethod ReferencesKinds of method referencesKinds of method references
A static method (ClassName::methName)An instance method of a particular object(instanceRef::methName)A super method of a particular object (super::methName)An instance method of an arbitrary object of a particular type(ClassName::methName)A class constructor reference (ClassName::new)An array constructor reference (TypeName[]::new)
Method ReferencesMethod ReferencesMore ExamplesMore Examples
Consumer<Integer> b1 = System::exit;Consumer<String[]> b2 = Arrays::sort;Consumer<String> b3 = MyProgram::main;Runnable r = MyProgram::main;
Default MethodsDefault MethodsAdd default behaviors to interfaces
Why default methods?Why default methods?Java 8 has lambda expressions. We want to start using them:
List<?> list = ...list.forEach(...); // lambda code goes here
There's a problemThere's a problemThe forEach method isn’t declared by java.util.List nor thejava.util.Collection interface because doing so would break
existing implementations.
Default MethodsDefault MethodsWe have lambdas, but we can't force new behaviors into current
libraries.
Solution: default methods.
Default MethodsDefault MethodsTraditionally, interfaces can't have method definitions (justdeclarations).Default methods supply default implementations of interfacemethods.By default, implementers will receive this implementation if they don'tprovide their own.
ExamplesExamples
Example 1Example 1BasicsBasics
public interface A {
default void foo() { System.out.println("Calling A.foo()"); }}
public class Clazz implements A {}
Client codeClient code
Clazz clazz = new Clazz();clazz.foo();
OutputOutput
"Calling A.foo()"
Example 2Example 2Getting messyGetting messy
public interface A {
default void foo(){ System.out.println("Calling A.foo()"); }}
public interface B {
default void foo(){ System.out.println("Calling B.foo()"); }
}
public class Clazz implements A, B {}
Does this code compile?
Of course not (Java is not C++)!
class Clazz inherits defaults for foo() from both typesA and B
How do we fix it?
Option A:
public class Clazz implements A, B { public void foo(){/* ... */}}
We resolve it manually by overriding the conflicting method.
Option B:
public class Clazz implements A, B { public void foo(){ A.super.foo(); // or B.super.foo() }}
We call the default implementation of method foo() from eitherinterface A or B instead of implementing our own.
Going back to the example of forEach method, how can we force it'sdefault implementation on all of the iterable collections?
Let's take a look at the Java UML for all the iterable Collections:
To add a default behavior to all the iterable collections, a defaultforEach method was added to the Iterable<E> interface.
We can find its default implementation in java.lang.Iterableinterface:
@FunctionalInterfacepublic interface Iterable { Iterator iterator(); default void forEach(Consumer<? super T> action) { Objects.requireNonNull(action); for (T t : this) { action.accept(t); } }}
The forEach method takes a java.util.function.Consumerfunctional interface type as a parameter, which enables us to pass in a
lambda or a method reference as follows:
List<?> list = ...list.forEach(System.out::println);
This is also valid for Sets and Queues, for example, since both classesimplement the Iterable interface.Specific collections, e.g., UnmodifiableCollection, may overridethe default implementation.
SummarySummaryDefault methods can be seen as a bridge between lambdas and JDKlibraries.Can be used in interfaces to provide default implementations ofotherwise abstract methods.
Clients can optionally implement (override) them.Can eliminate the need for skeletal implementators like
.Can eliminate the need for utility classes like .
static methods are now also allowed in interfaces.
AbstractCollectionCollections
Open ProblemsOpen ProblemsCan eliminate the need for skeletal implementators like
.AbstractCollection
Can we automate this?Can we automate this?1. How do we determine if an interface
implementor is "skeletal?"2. What is the criteria for an abstract method to be
converted to a default method?3. What if there is a hierarchy of skeletal
implementors, e.g., AbstractCollection,AbstractList?
4. How do we preserve semantics?5. What client changes are necessary?
Skeletal ImplementatorsSkeletal ImplementatorsAbstract classes that provide skeletal implementations
for interfaces.
Let's take a look at the Java UML for AbstractCollection:
Open ProblemsOpen ProblemsCan eliminate the need for utility classes like .Collections
Can we automate this?Can we automate this?1. How do we determine if a class is a
"utility" class?2. What is the criteria for a static method to
be:Converted to an instance method?Moved to an interface?
3. How do we preserve semantics?4. What client changes are necessary?
Let's start with question #2 for both the previous slides. There seems tobe a few cases here:
# From a class To an interface1. abstract method default method2. instance method default method3. static method default method4. static method static method
Can you see any difference between cases #1 and#2?Is case #4 a simple move method refactoring? (Yesbut to where? -- more later)
Why Is This Complicated?Why Is This Complicated?Case #1 corresponds to moving a skeletal implementation to an
interface.
# From a class To an interface1. abstract method default method
For case #1, can we not simply use a move method refactoring?
No. The inherent problem is that, unlike classes,interfaces may extend multiple interfaces. As such, wenow have a kind of multiple inheritance problem to
deal with.
Case #1Case #1Some (perhaps) Obvious PreconditionsSome (perhaps) Obvious Preconditions
Source abstract method must not access any instance fields.Interfaces may not have instance fields.
Can't currently have a default method in the target interface withthe same signature.Can't modify target method's visibility.
Some Obvious TasksSome Obvious TasksMust replace the target method in the interface (add a body to it).Must add the default keyword.Must remove any @Override annotations (it's top-level now).If nothing left in abstract class, remove it?Need to deal with documentation.
Case #1Case #1Some Not-so-obvious PreconditionsSome Not-so-obvious Preconditions
Suppose we have the following situation:
interface I { void m();}
interface J { void m();}
abstract class A implements I, J { @Override void m() {...}}
Here, A provides a partial implementation of I.m(), which also happensto be declared as part of interface J.
Case #1Case #1Some Not-so-obvious PreconditionsSome Not-so-obvious Preconditions
Now, we pull up A.m() to be a default method of I:
interface I { default void m() {..} //was void m();}
interface J { void m(); //stays the same.}
abstract class A implements I, J { //now empty, was: void m() {...}}
We now have a compile-time error in A because A needs to declarewhich m() it inherits.In general, inheritance hierarchies may be large and complicated.Other preconditions may also exist (work in progress).
Why Is This Complicated?Why Is This Complicated?Case #3 corresponds to moving a static utility method to an interface.
# From a class To an interface3. static method default method
For case #1, can we not simply use a move method refactoring?
No and for a few reasons:
Method signature must change (not only removingthe static keyword).Client code must change from static method callsto instance method calls.Which parameter is to be the receiver of the call?What is the target interface?
Case #3Case #3Some (perhaps) Obvious PreconditionsSome (perhaps) Obvious Preconditions
The source method vaciously doesn't access instance fields.Default version of the source method can't already exist in the targetinterface.
Some Obvious TasksSome Obvious TasksMust add the default keyword.If nothing left in utility class, remove it?Need to deal with documentation.
Case #3Case #3Some Not-so-obvious PreconditionsSome Not-so-obvious Preconditions
/** * Copies all of the elements from one list into another. */public static <T> void Collections.copy(List<? super T> dest, List<? extends T> src);
Should this be a static or default method?Call it as Collections.copy(l2, l1) or l2.copy(l1)?
It's probably more natural to leave it as static .Also, we can't express the generics if it was refactored to adefault method.
The generics here express the relationship between the twolists in a single method.We can't do if it was default.
Case #3Case #3This method should actually move to the List interface and remainstatic, but:
What is there's another method named copy in the List interface?List is an interface, and interfaces can extend other interfaces.
What if there's another method with the same signature in thehierarchy?
Case #3Case #3You may be tempted to move the copy method to a default method inList, but since the method uses generics and expresses a very distinct
relationship between two two Lists, you will lose the type safetyoffered by the generics. For example, suppose you have:
List<String> l1;List<String> l2;
Now, you copy the contents of l2 into l1:
Collections.copy(l1, l2);
If l2 is, instead, List<Integer>, you will receive a compile-time error.However, if copy was a default method of, say, the List interface, we
would have something like this:
l1.copy(l2)
Making l2 a List<Integer> would not result in a compile-time error.
Case #4Case #4Determining the target interface for caseDetermining the target interface for case
#4#4We can apply a heuristic: take the least common interface of the
parameters. For example:
public static void m(I1 p1, I2 p2, ..., In pn);
Here, we would take the closest sibling to I1, I2, ..., In as the targetinterface. Otherwise, we normally take the first parameter if it's an
interface.
java.util.streamjava.util.streamfilter/map/reduce for Java
java.util.streamjava.util.streamList<Student> students = ...;Stream stream = students.stream(); // sequential version
// parallel versionStream parallelStream = students.parallelStream();
traversed onceinfinitelazy
java.util.streamjava.util.streamStream sourcesStream sources
CollectionsCollections
Set<Student> set = new LinkedHashSet<>();Stream<Student> stream = set.stream();
GeneratorsGenerators
Random random = new Random();Stream<Integer> randomNumbers = Stream.generate(random::nextInt);// or simply ...IntStream moreRandomNumbers = random.ints();
From other streamsFrom other streams
Stream newStream = Stream.concat(stream, randomNumbers);
java.util.streamjava.util.streamIntermediate operationsIntermediate operations
.filter - excludes all elements that don’t match a Predicate
.map - perform transformation of elements using a Function
.flatMap - transform each element into zero or more elements byway of another Stream.peek - performs some action on each element.distinct - excludes all duplicate elements (equals()).sorted - orderered elements (Comparator).limit - maximum number of elements.substream - range (by index) of elements
List<Person> persons = ...;Stream<Person> tenPersonsOver18 = persons.stream() .filter(p -> p.getAge() > 18) .limit(10);
java.util.streamjava.util.streamTerminating operationsTerminating operations
1. Obtain a stream from some sources2. Perform one or more intermidate operations3. Perform one terminal operation
reducers like reduce(), count(), findAny(), findFirst()collectors (collect())forEachiterators
List<Person> persons = ..;List<Student> students = persons.stream() .filter(p -> p.getAge() > 18) .map(Student::new) .collect(Collectors.toList());
java.util.streamjava.util.streamParallel & SequentialParallel & Sequential
List<Person> persons = ..;List<Student> students = persons.stream() .parallel() .filter(p -> p.getAge() > 18) .sequential() .map(Student::new) .collect(Collectors.toCollection(ArrayList::new));
Documentation & InterestingDocumentation & InterestingLinksLinks
http://download.java.net/jdk8/docs/http://download.java.net/jdk8/docs/api/https://blogs.oracle.com/thejavatutorials/entry/jdk_8_documentation_developer_previewhttp://docs.oracle.com/javase/tutorial/java/javaOO/lambdaexpressions.html
Questions?Questions?