Skip to content

Commit bb917fc

Browse files
committed
[SPARK-12712] Fix failure in ./dev/test-dependencies when run against empty .m2 cache
This patch fixes a bug in `./dev/test-dependencies.sh` which caused spurious failures when the script was run on a machine with an empty `.m2` cache. The problem was that extra log output from the dependency download was conflicting with the grep / regex used to identify the classpath in the Maven output. This patch fixes this issue by adjusting the regex pattern. Tested manually with the following reproduction of the bug: ``` rm -rf ~/.m2/repository/org/apache/commons/ ./dev/test-dependencies.sh ``` Author: Josh Rosen <[email protected]> Closes apache#13568 from JoshRosen/SPARK-12712. (cherry picked from commit 921fa40) Signed-off-by: Josh Rosen <[email protected]>
1 parent 5830828 commit bb917fc

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

dev/test-dependencies.sh

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -84,7 +84,7 @@ for HADOOP_PROFILE in "${HADOOP_PROFILES[@]}"; do
8484
echo "Generating dependency manifest for $HADOOP_PROFILE"
8585
mkdir -p dev/pr-deps
8686
$MVN $HADOOP_MODULE_PROFILES -P$HADOOP_PROFILE dependency:build-classpath -pl assembly \
87-
| grep "Building Spark Project Assembly" -A 5 \
87+
| grep "Dependencies classpath:" -A 1 \
8888
| tail -n 1 | tr ":" "\n" | rev | cut -d "/" -f 1 | rev | sort \
8989
| grep -v spark > dev/pr-deps/spark-deps-$HADOOP_PROFILE
9090
done

0 commit comments

Comments
 (0)